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FOREWORD 



Tha Faculty Development in Nursing Education Project, a three^yi 
grant administered by the South ein Regional Education Board, aims to help 
nurse educators at twenty institutions to enhance teaching and learning 
axperiences. Each year of the project period a regional conference is held 
for, biit not limited to^ nurse educators at the project sites. These con- 
ferences provide opportunities for faculty to share experiences and to 
address pertinent issues in the provision of effeqtive. teaching and learning 
experiences* Evaluation; The Hidden Agenda was the topic of the Second 
Regional Conference. 



INTRODUCTION 

The second regional conference of the Faculty Development in Nursing 
Education Project convened in Atlanta, Georgia at the Terrace Garden Inn on 
October 22-24, 1978. The conferGnce was attended by 150 persons reprosenting 
the 14 SREB states*^ four state boards of nursing (Alabama, Kentucky, 
Louisiana, Virginia) and 25 associate dagree^ 17 baccalaureate ^ and nine 
baccalaureate and higher degree nursing programs in the region* 

The conferencG, dove loped around the themo *'Eval Uatlon : The Hidden 
Agenda,'' was designed to provide an opportunity for participants to: 



1) identify personal and' professional values reflected in 
educational programs; 

2) identify values reflected in theoretiGal and clinical 
evaluation tools; 

3) compare and contrast strateyies for clinical evaluation of 
nursing students; 

4) compare and contrast selected evaluation instruments for 
different teaching strategies; 

5) identify value conflict and congruity that impede or 
enhance the teaching and learning process; 



*The 14 member states of the Southern Regional Education Board (SREB) arei 
Alabama ^ Arkansas ^ Florida, Georgia, Kentucky, Louisiana, Maryland, 
Mississippi ^ North Carolina, South Carolina, Tennessee, Texas, Virginia, 
West Virginia. . ' 



6' 



6) design strategies for resolving value conflicts that 
impede che teaching and learning process. 

The conference began on Sunday, October 22 with presentations by the 
consultants, Eleanor Lynch, Associate Professor and ReBearch Associate in 
the Department of Nursing at Hampton Institute, and Sue Legg, Assistant 
Director of Testing at the university of Florida in Gainesville. Ms. Lynch 
and Dr. Legg provided the theoretical framework for the two concurrent work 
sessions on Monday morning. These sessions allowed participants to address 
specific issues regarding theoretical and clinical performance evaluation.s . 
• Following the consultants' wrap-up session on evaluation Monday after-j 
noon. Norma Rawlings, Assistant Professor in the School of Nursing at thej 
university of Maryland at Baltimore, and Ann P. Morgan, Professor in the | 
School of Nursing at the University of Maryland at Baltimore, led a dis- ! 
cussion of faculty and student interactions. Videotapes of simulated 
situations involving students and .faculty were used to stimulate this 
discussion* 

. The following quotation, was most appropriate in concluding the sessioA 
on Mondav ; , . 



No one is other rh&n a different person. DI f ference^ i s the 
most rhprished quality that human boings can have. Seeing 
peup'e as other than different subverts the potential of this 
ch6>riuhed numan quality. Perceiving all peorle as inevitable 
and properly different brings all educational plann mto a 
focus that promotes a dynamic i nd I v t dua I i fy among tlic total 
population. Perhaps I would conclude that "When They- Are 
Different" neans I've finally begun to see when I lo^k. i 



1r. L. Shannon. "Where the Trut h Comes Out ," Humanistic Education. Columbus, 
Ohtot Charles E. Merrill, 1971, p. 84. 
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The concluding session of the conferenco on Tue^iday morning consisted 
of four special interest groups. Those groupa rapreEionted the major arenas 
of concentration ^.t the 20 project sites* The special groups and facili-- 
tators were I 

Teaching and Le arning Sty les . Janet Awtrey, Associate Professor, 
DeloiS Skl^with, Assistant PrDfessor, and Kathleen Goldblatt, Pro- 
fessor, the University ol Alabama SchoQl of Nursing in Birminghain, 
discussed activities related to cognitive mapping and its in\^ 
plication for teaching and learning which are un^lerway in their 
prog ran. 

Identify in'^ Learning Obstacles, Gail Kettlewen, instructor of 
Developmantal Studies, Goldie Bradley, Assistant Professor, and 
Fred Jeffcoate^ counselor, thy Nursing Division at Tidewater 
Community College^ described their program's ongoing activities 
to identify learning obstacles. 

Management of Teaching S trategies. Kathleen Mikan, Professor and 

Director of The Learning Resource Center at the University of 
Alabama School of Nursing in Birmingham , used slides and several 
group activities to help participants examine their use of various 
teaching strategies^ 

Cultural Awareness . The implications of cultural diversity for 
teaching and learning V7tre explored in this group. Norma RawlingS, 
Assistant Professor, and Ann P. Morgan, Professor, the School of 
Nursing at ""the-University' of ^ Maryland at Baltimore ^ and Mary Guidryj 
Assistant Professor in the Sc' ool of Nuisihg at the University of 
St. Thomas, were the catalysts in this special interest group. 

The ma,jor presentations and highliglits from the special interest, groups 
follow. 



3 



8 



THE THEORETICAL PERSPECTIVE ^bN EVALUATION 
Sue Legg 

Evaluation Is Part Of The Remedy 



Tlie American educational enterpriae is like a gigantic 
beast, which on close examination displays some healthy tissue/ 
some diseased tissue^ and some scar, tissue. There is room for 
controversy about how healthy or sick- the creature actually is* 
Pessimists will say that the creature's death is imminent and 
unavoidable. Optimists will say that this creature is not 
dying any faster than is natural, and will foresee a long and 
useful life for it. It is possible that the creature is not 
well enough understood for us to know how healthy or sick it Lb 
{Cooley and Lohnes^ p.J) . . 

The metaphor created by Cooley and Lohnes seems appropriate for the 
discussion of the methods we use to meet the challenges of educating the 
diverse stude:;ts in higher education. Clearly, the beast of higher educatio 
has been upset by a change in diet 4 Instead of gracing on the traditional 
student, it finds its trough filled with the culturally diverse student. 
,In addition to a difference in ethnic backgrounds these students may be 
transfers, occupationally oriented, underprepared, disadvantaged, and older* 
These students upset the beasts they may not respond well to' the traditional 
instructional treatments. 

The usual lecture method is supposed to stress the analysis of ideas, ^ 
but most of the newer students have little interest in theoretical knowledge 
Even though many studies have found that lectures emphasize factual content 
more often than ideas, the sheer volume of information overwhelms many 
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.students. Thus, the beast tends to spit thein out of the system rather 
quickly. 

How do we adapt this beast to its diet of new studsnts? Doctors of 
education have offered remedies in several categories. In a review of the 
research on instructional methods, McKeachie (1974) reported the strengths^ ^^^^ , 
and weaknesses of a variety of teaching methods. One collection of methods, 
self-paced instruction, is a reaction to the inhumanity of the beast. The 
Keller"plan, PSI, and audio-tutorial instruction ate all perscribed medicines 
guaranteed to soothe the beast and improve its diet, lach of these methods 
is based upon similar priniclplesi the student should know precisely /hat to 
learn, practice and feedback are needed, the material should be sequenced in 
small' unit's of instruction with teacher-prepared supplements to replace 
lectures. Students interact with the materials and the tutors, and proceed 
as they master each unit. 

The philosophy which underlies these approaches is that time to learn, 
not intelligence, differentiates student achievement. It is this time factor 
that can be the "Achilles heel" of self-paced instruction. Materials must 
be self-explanatory or the utility of the method, is lost. Procedures must 
be carefully struc trued or procrastination becomes the bane of self -paced 
instruction, and high withdrawal rates and incomplete grades often occur. 

Another school of educational medicine calls for artificial organ 
transplants — educational technology in the form of television, teaching 
machines, and simulations. But, research indicates that the effectiveness 
of machines is limited when interaction wt h instructors is lacking. These 
methods do not stand alone. 



We are confronted with a variety of students and an array of teaching 
tochniquGs. It is our values as oducators that doturminu whether we sou tho 
problem as the changed diet in the form of a diverse student body, or as the 
failure of the digestive system of higlier education to adapt. How we view 
the problem determines the curative iDrocedures wo propose. VJe must do soina 
hard thinking about what we are trying to do in our classrooms and with our 
curriaula. If we ascribe to the value of open access to higher edacation or . 
the value of individuality, different teaching strategies must be adopted. 
This cannot be done in a haiDhazard way, any more than serious illness can be 
cured with Aunt Nellie's poultice or fists full of vitamins randomly selected. 
Not only must student bodies be properly analyzed, but there must be a 
Gomprehensive and organized plan' to administer dietary supplements. 

The traditional lecture method provides factual content. That rnaterial 
can still be presented, but it is how the material is organized that deter- 
mines how well it is assimilated. Similarly, if conceptual learning is the 
goal, situations must be structured to insure pupil/ instructor interaction. 
The latust curative lies in the proper management of diverse teaching 
techniques. 

. Good management techniques recognize the learning characteristics of 
the students. Research in cognitive learning styles sensitizes us to the 
different ways people learn. If we are concerned with the new students who^ 
have a history of low academic achievement, then we must be aware of their 
approach to learning. Patricia Cross, for exainple, argues that low achieving 
students approach learning with the "fear of failure" syndrome. Unlike 
academically orianted students who prefer tasks in which they have a 50^50 = 
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chance to succeed, low achievers tend to prefer tasks in which success is 
either quaranteed or so remote that failure can be easily rationalized. In 
this situation,- the instructor must try- to overcoma a passive approach to 
learning. If you fail long enough, you cease to try. Another characteristic 
of the new students r particularly those from blue-collar backgrounds^ is 
their tendency to accept authority. Therefore, they often prefer explana^ 
tion to problem-^solving. This characteristic complicates our role as edu- 
cators. If the new students require self-parked instruction to learn, but 
prefer to have material explained in 'lectures, what do we do? The answer 
seems to be in a combination of methods which emphasizes the development of 
an independent approach to learninq. The literature suggests that instruc- 
tion be individualized, tightly structured ^ and well-managed. A variety of 
techniques, including lectures, motivates students and helps them integrate 
material . 

We have examined the beast and found what ails it. It suffers from 
growing pains and a rich diet. Diagnosing the problems and categorizing 
the remedies is important but inadequate j even better management of treat- 
ments is not enough. How do we know if the beast is getting well? Again 
we are confronted with our values. In evaluating the beast, what we measure 
and how we measure it riflect our values. If we test only to assign grades, 
we devalue accountability to the educational system and to the student, and 
we often find ourselves in an antagonistic relationship with both. If we 
test for mastery of skills, we use criterion-referenced measurenient . Stu- 
dents are pitted against specific learning objectives, not each other. Yet, 
how do we know that our standards for mastery are meaningful? If \m use 
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nom-riiferenGed tests, studants .compete against each other^^not a productive 



situation for ihsecure students, 

Siinple logic dictates that our test should reflect what we teach. We ^ 
teach for specific skills and for the ability to transfer learning to new 
situations. Therefore, we should test for both. Testing, like teaching, 
requires a variety Of methods,' , ' 

The difficulty in tasting' is to jhrase items^ which actually require 
different intellectual abilities. Essay tests do not guarantee that, con-Vv. 
ceptual understanding is being measured. Objective tests may include items 
which measure a variety of intellectual abilities. Recently 1 conducted a 
study to find which abilities would predict success on essay and objective \ 
tests over the same content. The results showed that certain students bk- 
celled on the objective test because they^., excelled on abstract or transfer, 
of learning items. Studentfe wlio performed better on concrete items ^drawn \, 
directly from course material also scored higher on the essay test. It is, 
therefore, not only the academic level of the student or the -form of the 
test, but also the nature of the item that must be considered in constructing, 
tests. If what we are testing is not what we are teaching, then hov; do we 
know if the diet is improving, and t^m beast is getting well? 

References: ' ' ' - n . 

Coo ley, W, and Lohnes, P, Evaluation Research in Education . New Yorki 
• irvington Publishers, 1976, 

Cross, K, Patricia Beyond, the Open Poor . Sftn Francisco ^ Jossey-Bass, 1976, 
Frase, L, ^ "Advances Tn Research and Theory in Instructional Technology'' ' 

In Kerlingey (Ed.) Review of Research in^ Education . Itasca: F.E. 

Peacock, 1975. ■ ■ . ' , 

McKeachie, W. J* and Kulik, J. "Effective 'College Teaching" , tn Kerlinger 

(Ed.) Review of Research in Education. Itasca: F, Peacock, 1975, 
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steps In Writing Examinations ' 

• 1 . • ... 

I 

i 
! 

I,. PLANNING THE TEST - . ■ ^ ' 

! ^ _ 

Too often test development is a hurried^ last minute affair,; The major 
purpose of the ^test is to assign a grade, not to evaluate learning. If 
testing is to- be related to learning in a meaningful way, there is a test 
development procedure. This procedure includes planning not only the test^ 

and the items, but also evaluating the effectiveness of the testing process. 

' " ^ ^ . j " ■ ^ 

The first step is to identify the objectives to be tested and to set 
the test specifications. The usual procedure is to develop a test blueprint 
which includes the test objectives and the cognitive level of the items. The 
test objectives are weighted by assigning a percentage of the test items to 
each objective. Thus, a test which coyer s five areas equally would have 
twenty percent of the Items assigned to each objectaive. Some objectives may 

j 

emphasize factual knowledge while others stress understanding or application 
of knowledge. Therefore/ it is useful to place the objectives^ on one axis . 
of the blueprint and the cognitive level on the other axis. In this way the 
test can be balanced by content and cognitive requirements. In the example 
^ below of a SO^item test (Table 1) , four'content areas and three cognitive levels 
are to be tested. Eighteen percent of the Items. (9 items) relate to the com- 
fort of the patiant. Thirty percent of the test ^(15 items) ^ require a knowledge 
of nursing tenninology in the four content areas. - - I , 



Table 1 





; EXAMPLE 

- i 


OF A TEST 


BLUEPRINT 








Objectives 






Course 
Content 


i 

L eiinino j.oqy 

i - - 


Under* 


r'Al r*iilatiori 

\^ W% ^4= \rk >^ W A i 


Weight 


Comfort 


^ 3 ^ , ' - 


5 


1 

1 i 


18% (N-9) . 


Hygiene 


6 : 


7 


2. ; 


* , 3tf% (N^15) 


Safety 


' 3 


5 


3 


22% (N^ll) 


Nutrition 


3 


3 


9 


30% (N^15) 


Weight 


30% 


40% 


30% 






(N-IS) 


(N^20) 


- (Nsl5) 


" 50 Items 


Sevaral 


taxonomies have bi 


3Gn develoDad to assist 


inatruetors in 



specifying the^ cognitive level of ..test items. Bloom's (1956) taxonoiny is 
familiar to many instructors. Another taKonomy which may relate more 
closely to nursing content waff developed by Ebal (1965), The two taxonomies 
are shown below. ^ . • 



B 1 bom * s Ta XQ no my 

Knowledge 

Comprehension 

Application 

Analysis 

Synthesis 

Evaluation 



Ebel ' s Taxonomy 

Terminology 

Understahding ' 

Explanation 

Calculation 

Prediction 

Recommendat ion 

Evaluation 
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II. PLANNING THE ITEMS 
= Iteni Format 

The choice of item format. is related to the nature of the content, ^ the 
test objectives^ and the time available to write items, Thorndike and Hagan 
(1969) H^ve sumlnarized the advantages of various formats. Positive attri= , 
butes have been signaled by plus signs in Table 2^ while distinct dis- 
adyantages have minus signs ^ . ^ 

Item Difficulty 

Plan the difficulty of the items irt conjunction with the objectives for 
the course. The more difficult items contribute more to the total score. 
If the difticuit items are concentrated in one content area, the area will 
unequally weight the total score . 

. ' ■ . IVSK ^ . 

_a. Should, difficult items be from all content areas?. ^ ' 

b. 'if one area is more difficult/ should it include fewer items 
to balance its effect on total test score? 

To modify the difficulty level o"f the^items: . . , ■ 

a/ Use compound* response (£ and £ responses are correct 
but not b ) . 

b. Increase the cognitive level 

.c. Make options more hompgeneous , a. 

d. Avoid trick questions or obscure, facts,- they reduce 
test reliability : ' - 

? " - 13 ^ ■ ^ 



' Table 2 

RELATION OF ITEm} TYPE TO TEST OBJECTIVES 



f 

Factor 


Essay or 
Ora]. 


Short 
Answer 


Objective 


Ability to organize 




+ 




Discourages bluffing 






+ + 


Potential diagnostic 
val ua 






+ + 


Easily and reliably 




+ 


+ + 


Takes little tlma 
to prepare 




+ 


- 


Measures higher 
mental processes 


+ + 




+ + 

* 


firoad cont^ent". 
sampling . ' 








Measures, applica,tion 






+ + 


Adequate sampling of 
objectives r\ 




+ 




Reduce Guessing 








Planning the appropriate difficulty 


increases the reli 


ability of the 


test and reduces the effect 


of guessing. 


The major points 


in setting 



difficulty are listed on the following page., 



1* The difficulty level of ari item is the parcent of the examinees - 
who correctly answer an item* The difficulty of the items is 
related to' guessing in the following way. If there are four 
alternate/ responses to an !item> and the difficulty level is ,70, 
then the 30 percent who failed the itei; wouid be distributed 
equally over the three incorrect responses. Therefore,, the 
possibility of guessing any single resporise including the correct 
one^ is 10 percent^ Thus, while 70 percent .of the students 
correctly responded, it is; likely that 60 percent actually knew 
the correct answer. The more difficult the item, the greater the 
effect of guessing. This concept is illustrated below in Table 3. 



Table 3 
CONSIDER THE GUESSING RATE 



30% fail 




2, ^ "Ideal" difficulty levelr The goal q£ a test intended to dif- ' 

ferentiate among students is to construct itims with a medium level 
of difficulty and a narrow range of difficulty* Lord .(1952) 
pubiished the following levels of difficulty (Table 4), to maKimize 
test reliability. s - , . 



15 



18 



Table 4 

GUIDE FOR PREPARING TESTS WITH DIFFERENT ITEM FORMAT 



1 


Ideal Average 


item Format 


Difficulty 


Completion and shi^rt answer 


50* : . 


Five-response multiple choice 


70 


Four- response multiple choice 


■ ' 74 


Three^-ra^ponse multiple choice 


77 


True-^false 

, : — " 


. 85 



*Expect a student of average ability to answer 
about one^half the items correctly. 



III. WRITING THE ITEMS 



Construction 



Adequate planning is essential to insure the validity of the test, / 
i.e,, the teat is relevant to what was taught. Careful construction or the i 
itemp makes a test reliable, and a reliable^ *.est measures what it Is in^ M 
tended to pleasure. Common sources of measurement error can bf reduced if > I 

■ ' " ' ^ ■ ' ' ' i 

the folloi^ing rules are observed: * ; 



(i) Use four of five choices per item. 

' i2) Use plausible distractors^ - 

(3) Fit each choice grammatically with the st 

(4) Test content, not reading level. 

(5) Keep, choices short &nd about the same length. 

(6) Include bnly one correct answer. 

(7) . Give clear directions. > 

(8) Vary the position of the correct response. 



IV . ANALYZING THE TEST \ _ ^ 

After the test is constructed and administered, both student achxvement 



16 



19 ^ 



and the adequacy of the test can bo evaluated , The individual item contri- . 
bution to last ^reliability can be assessed. The incorrect responses in a 
single foil may iiidicate problems in the wording of the items. Another 
factor in assessing the effectiveness of an item is the ability of the item 

to discriininate between high and I'ow scoring students* 

I ■ . '= 

Table 5 

ANALYSIS OF THE TEST RESUj^TS . 



Item Responses 

-I • . . 

- 'i Discrimi-- 

a b c . , d. . . e Difficulty nation 



1, 


2 


4 


243+ 


\ 2 


■ 1 


0.96 




OJOO 


2, 


26 


21 


28 


149+ 


23 


0,59 




0.51 


3 ^ 


0 


0 


5 


12194^ . 


28 


0.86 




0,09 



Item Analysis j > ' ■ 

; PurposSi Item analysis h^elps to deterininf the .adequacy of the items 

within a test as well as the adequacy of the test itself. The results of an 

item "analysis provide dnformation about the^ difficulty of the i items and the^ 

ability of the items to discriminate between better and poorer students. 

Method; The inde x of .difficulty is defined as the proportion of 

students who correctly answer an item. The. avferage difficulty of ,a test is 

the average of^ the indiyidukl item difficulties. For maKJ.mum discrimination 

among students, average drfficulty of ,60, is ideal, 

' . Example: If 36 students answered item No, 1 correctly and 
14 students answered incorrectly, the difficulty 
level of the item would b^ 36/50' or .72. > .. 

' 17 ■ . . 




The index of discri mina tion is' a nmnerical •indicator o£ how the poorer 

students answered the itam as coiApared to how the better students answered 

the item, 'rhe, scores are divided into three groups with the top 27 percent 

of the scores in the upper group and the bottom 27 percent in the lower 

group. The number of correct responses for the item in the lower group is 

subtracted from the number of correct responses for the item in the upper 

group. The difference in the number correct is divided by the number of 

students in either group. The process is repeated for each item. 

Examples Sixty students take a test. The top 16 
scores and the bottom 16 scores are the 
upper and lower groups. For item No. 1, 
' . twelve of the sixteen students in the 

upper group answered the item correctly 
^ . while seven students in the lower group 

answered correctly. The index of dis- 
crimination for item No. 1 would be cal- 
culated as follows I . ^ 

^ . . 12 " 7 , .31 ■ . 

■ . IS ■ , 

For a small group of, students, an index of disurimination for an item that 

exceeds .20 is considered satisfactory. For larger groups, the index, should 

be higher because more difference betweeji groups would be expected. 

Reliability . may be defined as the degree of consistency^ or stability 

between itwo mea-ures of the same thing. ' When two measures are not available, 

•reliability is estimated by the degree to which the items cortelate with 

the total' score, when- the items are of equial difficulty, the KRar formula . 

to estimate reliability may be used.. When the items have. different levels of 

, difficulty, the KRji ^'iil underestimate, the reliability. Other formulas, are 

available, but they are 'tedious to compute by hand. ■, ■ ■■■ 
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where I = r^x = ^he 1^21 estimela of r" ii,ibi?ity 



N - the number of items in t'le c^st 
X = the mean score of the uotal test 

S^^ = the variance of the total test 



NS 
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WORKSHEET ON MULTIPLE CHOICE^ 



1 



1. The problem should be stated in the stem. 
(Poor) Betsy Rossi 



A- 

5, 



A. Married George Washington 

B, Made the flag 

C*. Rode with Paul Revere 



All options should^ be plausible. 
(Poor) An electron is ai 

A. 
B. 

- C, 
Avoid repeating words* 
(Poor) Anthropology isi 

A. 



Negative particle 
Positive particle 
Voting machine 



The study of human beha\ iOr 
The study of. animal behavior 
The study of insect jDehavior 



Avoid making the longest response correct. 

Avoid giving irrelevant clues due to grairanar, 

(Poor) The first explorers of. the Northwest were? 

A. Daniel Boone 
" B. Lewis and Clark 
^ C* Mason and Dixon 



6. Avoid unneGessary words. 

(Poor) the dndustrial revolution brought many changes to the 
- .--life. Outstanding among these was the cotton gin invi 

' A* Eli Whitney 

/ :■ ^ Thomas Edison * 



American 
mted by s 



way of 



^Handout used by Sue Legg. 
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7. Avoid using negatives, 

8. Place blanks near the end of the sentence, 



(Poor) A 



• a tax on imported goods . 



A* Sales Tax 

B. Tariff 

C. Levy 



Use none of the above or all of the above carefully, 

10* Arrange in orderly fashion.' Column'^ listing is usually easier to read. 

The Battle of Tours was fought ini 

A, 212 A.D. 
B- 732 A,D, 

1215 A.D. ' . 

In, evaluating the following items, aFrk ' \. 

Is the point important? 
« Is enough information provided in the stem? 

- Which cognitive level does the item measure? 

- Are" there common arrors in test conr' ;uction?A , 
^ Is there one answer which, is clearly correct? 



Care of Adults wit^ Surgical Conditions 

1, Samuel Babson , " \ , ^ 

; Based on the inforTnation provided about Mr* Babson, the initial nursing 
action would bg. to i ^ - 



1, Start oxygen 

2. Check vital signs 

3* place in shock position 

4, Notify the doctor 



2.1 
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When replacing fluids in burned patients, watar intoKication may present 
a complication. Which of the following manifestations should alert you 
that water intoxication inight be developing? 



a, tremors 

b. twitching 1^ all of these 
' c. diarrhea 2. b, c and d 

d. salivation 3. d only 

3, When burns are treated by the open method rather than pressure drassings, 
the nursing problems are especially great because of which of the 
patient's needs? \ 

a. The nped for greater isolation of the patient from sources of 
infection 

b. The need for a lower environmental teinperature 

c. The need for a lower environmental humidity 

d. The need for special measures in handling and moving the patients 

1. a and d 

2. a and b ■ ■ 

3. b and c - ■ . 

4. all of them 

4. A neighbor has'brought her burned child to you ^ for ^ advice. On which-of 
the following factors should you judge the severity of the burn? 

a. The rule of "eighteen" ^ - 

b, ,, The percent of body surface involved ■ . 
c/ Tbe depth of the body wound 

d* The amo\ant^ of pain 

1. a^ b and c ' ■ 

2 , b and c ' 
V ^ 3. b and d. • ^ ^ ■ , 

4* d only . " ^ ^ 

Maternal^Child Health Nursing 

Jane Davis just, delivered her first child. She is very excited about having 
a son; however, she tells the nurse that she is apprehensive about caring 
for her baby, Mrs, Davis asks the nurse about the rooming-in unit. 



The following'^^uestions relate to this situations 



5, Mrs. Davis has been, urinating frequently. This most likely is 
indiaative of i ■ . ' ■ ' \ . 



a. A nervous response 

b. . A postpartum cystitis 

c. An increased sensitivity of the bladder 

" d. The body's effort to return its waste metabolism to normal 

Mrs. Davis finds rooming--in a satisfying eKperience. She decides she wants 
to breast-feed, 

6. which of the following influences ttie_ success of breast^^feeding? 

a. The amount of fluid intake 

b. The amo\ant of colostrum secreted 

dp The amount of milk the baby desires 

d. The mother's desire to want to nurse 

7* Your patient hap alien in the bathroom and has a compound fracture. 
While waiting f medical help to arrive, you should:. 

a. Elevate the patient ' s head to facilitate ventilation 

b. Cleanse the wound with hydrogen peroxide to help prevent infectron 
c* Cover the wound with a dry clean dressing 
d. Spli.nt the fracture to prevent further injury • 
e* Give the patient fluids to help prevent shock . ' 

■ i ' ■ f _ _ . ' _ ! 

8* Below are.^four (4) common solutions used for enemas. P^ich one is the 
moat desirable solution? ^ ^ ^ i 

a. Tap water | 

b* Soap solution % ■ j 

" G* Hypertonic solution • / ■ 

. d.y Normal or physiologic saline solution " , , - ! 

9. Consider these two statements i 

a. Reductioa in the hemoglobin concentration of the blood is Jto be 
expected in pregnancy. 

b. Depression of erythrocyte production is a normal' development in 
pregnancy*, ' , v 

1, Both statements are true, and a helps to explain why ^ is true, 
2* Both statements are true, but £ does ndthelp to explain why b 

is truek'- , 
3p 2^ is true, b fal^e. ^ 
4, a is false, b true, 



Types Of .Items And Examples 



The type of item used is far less important than the care and thorough- 
ness with which the items are prepared. For most purposes ^ the regular 
multiple-chDice type of item has been found most satisfactory. However, to 
land variety to a test, there are several types of objective items which may 
be written -^^ each type having a number of variations. Several different 
types, with some examples of each, are given below* ^ . 

I. MULTIPLE-CHOICE ITEMS ' 

A, Straightforward Multiple-Choice , This is the most conunon type of^ - 
objective test item and is familiar to everyone. Two examples are 
given below* 

" 1, The fatigue of muscle is due primarily to , 

(1) the overuse of the individual muscle fibres 

(2) the production of lactic acid within the muscle cells ^ 

(3) excessive carbon dioxide production 

(4) a limitation of the oxygen supply 

(5) a limitatioh of the tood supply 

2, If a train runs x miles irt y^ hours, how far does it run in z_ 
hours? 

(1) K2 (2) xy (3) ^ (4) xyz (5) xy - z 
y z X 

Reverse Multiple-Choice . In this type of multiple-choice item, the 
studerTt is asked to select the one wrong answer* The use of this 
type is not highly recommended, since it tends to be confusing to 
students, but in cases where it is used, the work which indicates 
the negative, or reverse, quality of the item should be., capitalized 
and underlined, as follows^ 
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1,= Which of the following has NOT been derived from Darwin's 
thesis expressed in^ the Origin of Species? 

(1) the "argument from design, " demonstrating the existence 
and benevolence of God 

(2) the theory that the only standard for judging a line of 
conduct is its ability to make itself prevail 

(3) the theory that man is the product of caus.es which had no 
prevision of the end they were achieving 

(4) the theory that war is a fundamental law of development 

(5) the belief that ruthless self-assertion and cutthroat 
competition are principles to be followed 

2^x The various social security laws oJP the state and federal 

governments insure men at least partially against the hardships 
resulting from all of the following EXCEPT 

(1) ' unemployment 

(2) ' injury on the, job 

(3) old age 
(4j blindness 

(5) ill health " 

3* In which of the following was there the LEAST amount of 
economic freedom? 

(1) the manorial system - 

(2) the merchant-guild' system 

(3) the craft ^ guild system 

(4) the domestic system and the period of mercantilism 

Complex Multiple-Choice . This type of multiples-choice item allows 
for €he asking of more than one question at once* It does not/ 
however / allow credit for any partial knowledge* That im, the 
student must know all of the answers to receive credit on the item* 
This type is illustrated as follows ^ 

1* " Which of the following statements are correct according to the 
theory of the Bohr atom? % ^ 

a* The nucleus of ah atom contains only protons and electrons, 
b* The number of electrons in an atom in the normal state 

equals the number of protons* 
c. The nucleus of an atom contains protons and neutrons, 
dp The number of protons always gives the atomic number* 
e. An atom may lose one or more protons in ordinary chemical 

reaction. 

The correct answer is ^ ' . 

(2) b and d (3) d and e 

(5) a^ b; and c 



(1) a and c 

(4) b; c, and d 
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II. GROUP ITEMS 



p,^ ' CoimnQn-Data Items , This kind of group enables the exaniiner to ask 
several questions on a situation without the necessity for repeating 
,.^he data in each item. An example follows i 

1^3- In mice, ^ yellow coat color (Y) is.domiriant to non-yellow (y) , 
Whenever two yellow mice are mated, it is found' that their offspring 
always occur in a ratio of approximately two yellow to one non- v 
yellow. 

K 1, The two-to-one ratio obtained in matings of yellow mice is an 
eKaini^le of ^ 
(1) interaction of factors 
■ (2) hybrid vigor 

(3) sex linkage 

(4) complementary factors 
. (5) lethal factors 

2. The genotypes of the parent yellow mice are 

(1) both sexes Yy 

(2) both sexes YY ^ ' 

(3) both sexes yy 

'(4) one sex Yy, the other yy 

(5) one sex Yy, the other YY 

3. The cross also illustrates , ' \ ^ 

(1) independent assortment 

(2) multiple ef fects^ of a single gene ' ' 

(3) backcross = 

(4) bihybrid ratio 

(5) interaction of factors 

B. ' Key List items . A short or a long key list may be used for a group., 
of items, but since each item may have only five possible answers, 
a slightly different technique must be used for the long-key-list 
groups. 

Example of short^key-list groups. , 

1^5. Select from the key list the appropriate description or 
definition of each of these items. 



. \ 
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1. 

2, 
3. 



a statemant resulting from direct observation 
a statement of value 

a statement depehding- upon interpretation of a variety 



of evidance * 
4. a statement surmnariEing a group of instances 
5» a statement resulting froiTi agreement, differences, and/or 

concomitant . variation 



1, A generalization > _ - 

2, A simple fact / 

3, A statement of moral worth / 

4, A casual connection 

5, An hypothesis 

Diagr^ or Picture Groups^ - Diagrams may be used in the same maMner 
as a Tcey list is us^ed, if there are no more than 5 parts to be 
labeled. That is, the parts might be labeled 1^5, and the items 
written as follows^ ' = 

1-5, These items refer to the diagram above. Select your answer 
for each item from the diagram. 

1, _ Which part of the diagram represents the left ventricle? 

2. Which part of ^the diagram represents the left auricle? 

Also, a group of five illustrations might be used in the same manner 

Wher^ more than five parts of a diagram or locations on a map need 
to be identified, it is usually preferable^ to write items of the. 
multiple-'Choice type. Each item may begin with a. reference to one 
of the diagram symbolss For example! ^ 

6-20, These items refer to the diagram 1-5. 



The symbol A in the diagram refers to the 
(1) liver^ ^ . 



(2) pancreas 

(3) stomach 

(4) duodenum 

(5) spleen 
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7, The part labeled B is part of the . 
(1) Migestive system 

'(2) respiratpry system ^' 

(3) autono.iiic , nervous system 

(4) rdproductivo systcni 

{5) skeletal system > 

In certain fields it is effective to use small 'diaarains labeled 
1-5 as answers to ordinary multiple^choice items. For example i 

21, Which of the following graphs shows the greatest^ positive 
skewness? 



(1) 



(2) 



(3) 




ri llh 



(4) 



(5) 



COMBINATIONS OF VARIATIONS . ^ . 

There are many variations of each of the types of items mentioned, and 
many combinationB of types. On the following pages are given a few of 
these possibilities, . 

A. Variatibns of Diagram Type . 

117^122, Directions: In Tab^ e 1 certain body-parts or cells are 
" indicated by picture or by. name. Tljese are numberad and 
" : listed vertically. The horizontal line lists five of 

the chief types of tissues. Fill in the table by placing 
the letter x in the space which indicates the correct 
major tissue for the body-part named, ^ 
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Table 1 

A. 





BODY PART 


TISSUE TYPES OR CLASSES 




or CELL 


Epithe^ 
lial 
(1) 


Contract 
,tile 
(2) 


Nervous 
(3) 


Susten= 
tative 
{4) 


Reproduc- 
tive 
(5) 


117. 


Cartilage 












118. 


Bona 






- 






119, 














120, 


Egg 












121. 


Teeth 












123. 


. Red 
Corpuscles 

mm 














Variations of Classification Type . 

Items of the type illiAStrated below are useful in measuring how well 
students handle correlated or cause-^and-ef f ect relationships. In 
writing -^such items, where the relationship is definitely cause and 
effect, the cause should be given first. 

188-190. Answer each of these items. 

■ 1 if increase in the first of the things refjrred 
to is accompanied by increase in the sEcond, or 
if decrease in the first is accompanied by de^ 
crease in the second; 

2 if increase in the first of the things referred to 
" is accompanied by decrease in the second; 

3 if. the second of the things referred to remains ^ 
" constant, or "approximately constant, even though 

the first increases or decreases. 

188. Amount of carbonates dissolved in the water of a river 
Number of clams in ^ the river. 

189. Temperature of the environment of a maimnal- 
Body temperature of the mammal. 

190. Number of ^lemmings in an arctic area. 
Number of caribou in the same area. 

one means of presenting students with items which require reflective 
thinking rather than memory , alone is to set up hypothetical situ- 
ations which"' differ from the situations encountered during instruc-' 
tion. The items given below illustrate such a series. : 

200-203. You have acquired some knowledge of the earth and its 

motions as they really exist. In these items you are to 
identrfy the effects of some ^wholly imaginary conditions. - 
Answer each item 

1 if the statement would be true if the earth were not 
inclined on .its axis; 
.2 if the statement would be true if the orbit of the 
" earth were a circle rather than an ellipse ; 

3 if the statement Vould be true if the earth revolved 
^ toward the' west rather than toward the east; 

4 if the statement would be true if the earth had half 
^ its present diameter but retained its present mass; 

5 if the statement would be true if the earth had.no moon. 

(Assume only one of the above imaginary conditions occur 
at a time . ) 
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200. All the solar days would be of equal iength. 

201. Objects would weight oquator and the ecliptic would be identical, 

202, The ' celestial equator and the elliptic would be identical. 

203, The aun would set in the east. 

Mi n imum- 1 n for ma 1 1 on 1 1 ems . It is possible to write machine-acorable 
items in such a way that the correct answer is not actually shown. 
An illustration of such a method is given in the following items, 

. 1:^15. In each of these items a word is defined. Think of the word 
that fits the definition. Then mark on your answer sheet the 
rectangle corresponding to the choice which gives the first 
letter of the correct word. 

' '- ' ' 

1. Acceleration of a cheir ical reaction 'produced by a sub- 
stance which may bo recovered practically unchanged at 
the end of the reaction* 

(1) a (2) c (3) d (4) e (5) o 

2. The smallest particle of a substance which retains ^the 
prdperties of a substance, 

(1) a (2) c (3) m^^ (4) p (5) r 

In the first item, of course, the answer is 2^ because the word 
sought catalysis begins with a £; in the second ^ the answer 
is 3^ for molecule begins with an m. 
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LIST OF PERFORMANCE OBJECtlVrS RELATED TO; THE AREA OF COMMUNICATION TO nr EVALUATED BY 

' ' ' ' ' * (;oNrEiu:Nnr j'AiniciPANTsi 

Olroctions:' Rtjad Oiich behavior lisLod beluw, ntul ('valuiUo oflCh ono in tonim of whether or not, as 

stated/a clear description of the behavior to be observed is incorporatou in the stiUe- 
ment If your answer is "Yes"* place a {^) in the "Yes" column. If your answer is - 
"No", place a {^). in the "No" column. Use the "Unde-ldod" column if your decision is 



neitner "NO" nor "Yes., 

/ ^ . • ■ 
Clinical Objectivis x 

V Establishes and maintains effective reTationships 


Yes 


No 


Undecided - 


2, Uses clues'ffom client to determine receptivity to new ideas. 








3. Conmunicates oral ly wi th effectiveness . 








4. Respects the individuality and dignity of clients. 






="^'^=^^"--^ - - 


5. Makes effective use of periods of silence in coniTiunicating with 
cl'ients. - ^ 








6. Gives positive and negative^cyes to indicate a genuine response 
' in client interactions. 








' 7. Surrniarizes, at intervals, dialogue between the nurse and client. 








8. Confirms cues -in client's messages. 








—=^r——=-— —————— - - ---- 

9. Demons t rates a willingness to listen. 








- : -- — ~ - — - ^=^^^^--^^— ^ ' 

10. Evaluates nurse/cl ient interactions. 








11. . Applies appropriate measures to tope with barriers to corrfnunication, ' 








12. Describes meaningful patient behavior in objective terms. 






" 


11 ^slsf^te lannii^np ;innrnnrl3tp t"n fhp listener. 








Ih* nginLainT^ eye COMCdtL wl Lil ^ I Ifcilts UUI I'ly milci v lEtus-s 




" - — 




15. Uses concepts and comniunication techniques adequate to accomplish 
the intended purposes of nurse/client coniiiun i cat 1 on s , 






lo- wOnveys aCCeptanLe or (.iiciiL uuiiiiy iiurae/i^iicHL i^uiiiiiuii ■ ^ ■ wn . 








17, 'Maintains open channels of conrnunieation with clients, families, and 
"team members. 








18, Reports promptly pertinent Information about patients and clients to 
an appropriate member of the health team. 








19, Encourages client and 'family to verbalize their feelings. 








20, Interacts constructively as a client advocate with members of the 
health team, ' 








21. Develops therapeutic relationships with clients. 








22. fdentifies behaviors which refl ects alternations in system speech 
formation and transmission. 








23. Demonstrates controlling and directing feedback. 








24.^ Establishes tryst in nurse/cUent interactions. 









'handout used on October 23, 1978 
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. ^ THE CLINICAL PERSPECTIVE ON EVALUATION j 

• ' Eleanor Lynch 

^Clinical Components of Evaluatlpn 

INTRODUCTION ' ' ' - 

The basic principles of evaluation in educationai programs are applicable 
equally whether we are measuring the theoretical components or evaluating 
the Glinical components of nursing, whatever purposes are designated to be 
served by the evaluation of nursing students' performance in the clinical 
setting, they will pnly be served effectively if the evaluation process is 
' systematic, if the objectives to be assessed are stated unambiguously, and 

if the evaluators have agreed-^upon standards to be used Lo assess the extent 
^ to which the specified objectives have been attained by nursiftg students. 
We cannot judge whether objectives are being or have been achieved without 
knowing specifically what skills and abilities are expected to be^ attained 
by nursing students at, ^various stages in the educational program. 

Evaluation of the clinical components of a nursing course differs from 
the evaluation. of the theoretical = components in that the emphasis is on the 
assessment of behavioral skills related to performanGe — the "doing" 
aspect of nursing. A question that needs to be raised is^ "What will the 
nursing student be doing when she or he is demonstrating achievement of the 
behaviors designated to be assessed in the clinical setting?" Once this 
question is asked and answered . appropriately , it is unlikely that behaviors 

t ■ 
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to'bG assessed could bo stated in torma related to ''appreciating" or to '•ha^ 
the ability to." "Appreciating'* could mean holding in high regard. But, 
since the yerb could also mean exercising wise judgment , experiencing a . warm 
feeling, or ^faluing highly, the word is ambiguous unless defined more finitely. 
'•Has the ability to'' is too general a phrase., An auility is a construct. As 
a construct, the particular aspect cannot be evaluated as stated. A constr\^t 
is a psychological trait or quality which we presume exists in order to explain 
some aspect of behavior. The: particular ability in question must be cdnsidered 
in terms of simpler subsystem or subset behaviors. ^ Until we are able to iden-- 
tify the several subset or subsystem behaviors by analysis to determine the 
factors involved in thu ability, ^the construct cannot be evaluated or measured. 

' There is a need to be parsimbnious in evaluating student performance in 
the clinical setting./ We need to look very carefully at what we are evaluating' 
because the chief technique, observation, is an expensive method of evaluation 
generally involving a ono-to-ohe relationship between the nursing student and 
the instructor. Thersfore, it is important to differentiate those jaspects 
that can be economically and effectivQly measured by well -developed paper-and- ^ 
pencil tests from those aspects that require th - more expensive method of 
observation. It is necessary '^to plan carefully so that time and resources 
are not used ineffectively or uneconomically . 

BASIC FACTOR IN DEVELOPING A MODEL FOR 
PERFbRMANCE" EVALUATI ON IN CLINICAL SETTINGS 

" ^= ' . - - , 

Evaluation in a nursing program is a diverse and complex process in- 
volving the collection of pertinent information not only about the 
competency of the products of educational ■ programs , but also the process of 

evaluation itself. ' ' ' 
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Figure 1 provides the franievrark for the developmental components of the 
educational system. The horiEontal arrows represent a two--way feedback 
mechanism between each of the" developmental components of the system; the 
framework^ Evaluation of the Process and the Product^ and the vertical arrows 
represent a two-way feedback mechanisiu between the developmental Gomponents 
of ^ the system. The characteristics of the graduates i or compeitenGies and 
attributes/ reflect, the philosophy of the program and/ in defining the over^ 
all outcomes of the program/ the product is described. These general 
abilities provide a general direction for curriculum development and are 
basic to the determination of .the level of specificity needed in. statements 
of behavioral expectations at predetermined points in the program, i^e.^ at 
levels / for courses/ for learning experiences/ and for the development of 
evaluation tools. ' Evaluation i as conceptuaiized in Figu^re 1, is an ongoing 
process for the total curriculum as well as for the eva3uation of objectives. 

Formative and summative evalutition are two distinct and separate 
components of evaluation (Popham/ 1975^ 13^14). Formative evaluation is 
defined as those assessments of worth focused on instructional programs that 
are capable of being mod if led; summative evaluation is. defined as those 
assessments of value focused on completed programrsv ThuS/ formative evaluation 
provides on-going information about the effectiveness with which students are^ 
achieving objectives,^ Waiting until the end of the course to make such 
determinations is too late too late to serve any purpose of evaluatiou 
other than grading, i.e,/ summative evaluation* 

The goals of evaluation should be directed to improve/ not to prove. 
If we start out only to prove a point in relation to the evaluation process, 



Figure 1 
EVALUATION ( PROCESS/PRODUCT ) 

I 



Philosophy 



i 



competencies And Attributes 



I 



Conceptual Framework 



I 



Horizontal And Vertical strands 



Level objectives 



course Objectives 



unit objectives 



Le arhing Experiences 
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more than likely the decision-making procens will be based on either in-- 

♦ 

sufficient or invalid evidGnce. Evaluation directed toward the improvement 
of the educational program requires the gathering of pertinent evidence in 
accordance with specific plans for making judgments. 

Often an Inordinate amount of time is spent grading students' performance 
in the clinibal setting, e^g., every day or every week, and grading, instead 
of counseling and guidance, becomes the prominent issue. Do we allow students 
time to learn and understand the facets of patient care before grading them? 
Some.times faculty fail to allow time for students to learn. Rather, they 
gather information formatively, to see where the nursing student is on the 
continuum of achieving objectives and use the information for surranative^ 
purposes, 

: i 

•:■ 

\ ^ ^ •• 

VALUES AND EVALUATION IN CLINICAL SETTING 

- — . " . .i^ 

' M The values that we place on the purposes of evaluation can indeed, 
affect the validity, of decisions in relation to the outcomes of evaluation, 
Purpel and Ryan (1976) emphasized the point that education is a value^laden 
human activity with values being built into the curriculum in a number of 
ways. The use of authority, including how rewards and punishments are meted 
out, also carries with it a moral lesson. Since students often regard 
evaluation generally, and clinical evaluation in particular, in terms of 
rewards and punishment, a moral lesson is indeed involved in the .assessment 
of performance in the clinical area, 

Reilly (1975) asserts that in clinical evaluation the student is even 
more vulnerable than in any other evaluative experience. Therefore, faculty 
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need to focus, on this vulnerability and to do whatever they can to provide a 
comfortable, safe, secure environment that would promote rather than retard 
growth* Reilly supports Purpel and Ryan's contention that students regard 
evaluation in terms of rewards and punishinent and advises those engaged in 
clinical performance evaluation Xo establish a climate based on trust and 

acceptance* ' - ' 

Dorothy Smith (1977) contends that the considerable contact between 
faculty and students in the clinical setting influences the deyelopment of 
the students* values. Values and altitudes change more slowly and are often 
more nebulous than factual information. Thus, they are not usually subjected 
to the kind of scrutiny accorded hard facts. It is important to recognise 
the impact of a teacher'- system of values, beliefs and philosophy during 
clinical instructi'o?^ and clinical evaluation, - _ ■ 

Is problem-solving an essential component of educational programs in 
nursing? Are students given opportunities to use the problem-solving 
process in the clinical setting? For instance, 

A nursing student arrivGd at an hypothesis that is falla^ , - 
cious because it is not based upon a careful, analysis of nursing 
interventions likely to be effective, in resolving a particular 
client's needs. The instructor conveys annoyance and utter 
disbelief while enumerating the errors made by the student.' 

What effect will nuch a reaction haVe- on the student ' s ability to use the 
problem^solving process? What effect will such an approach have on the 
student's motivation? How could such an approach affect the student'' s 
growth in terms of her ability to solve problems? These' questions are 
pertinent , ; 

Do we orovide adequately for the growth of students? 'What about the 



. needs of students who demonstrate a high level J of ability? Consider the 

following situation i - 

During a post^Gonference session a nur? Lng student, whose 
performance is at a level, is attempting to express an idea 
in response to a question raised by the instructor* As the 
student slowly and haltingly speaks, another student, whose 
performance is at an A level, interrupts and pursues the sajne = 
idea. 

How should the instructor react if the less capable student stopu at this 
point? To say, "Will you please let her speak," would raust certainly be 
inappropriate* There is a possibility that the more capable student may= be 
unaware of her behavior and that her main objective mi gVit have been to 
help the less capable' student* in this situation, there is a need to 
provide the kind of environment that would promote the aepurity of both 
students* The instructor must react in a manner that supports both learners* 

Is there a tendency to focus more on students whose ability falls at 
the lower end of the ability scale? What happens to the student whose 
abilities fall at the upper end of the scale? Is it possible that this 
focus might lead to a disregard for the. needs of these students? Will these 
students, feeling unchallenged, leave nursing because they feel that their 
needs were not heing met? Will the ultimate loss to nursing be a loss of 
persons with leadership potential? Highly competent students need encourage-- 
ment and opportunities for grpwth* Their special lesson might be to leatn 
to use their special skills in a beneficial manner, >^ 

Figure 2 illustrates the multivariate system involving the interelation'" 
ship between a client, a nursing student, and an instructor with sl multi^ 
plicity of subordinate and su^raordinate components interacting* The components 
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are pert^inent whether we are talking about an agency, e.g., hospital, 
or a situation in which the nursing student is funotioning in a coTOnunity 
health agency* If we are dealing with an institution, or health agency, we 
are talking about formal organizations, while the family in the home would 
be a part of the social organization, ^ . . 

%n examinihg the interaction between the subordinate and the supra- 
ordinate component one observes the client interacting with the environment 
in which he happens to be in terms of health^care needs, the nursing in= 
structor serving in a supervisory capacity and the nursing student providing 
for the client's needs. This situation is unlike that of a student taking a 
test which focuses on knowledge related to the care of a patient. The clinical 
situation is a highly complex, multivariate entity invoiving a multiplicity 
of components. Nurse educators need to be .jnindful of this fact. 

If an instructor focuses on the concept of client advocacy as an 
iinportant role of the nurse in the theoretical segment of a course, in the 
clinical^ setting, the behavior of that instructor in relating to other 
members of the health-care team must be representative of thi^ concept. The 
instructor's behavior will influence the way students will refate to the 
concept of client advocacy. If the nursing student does not observe the 
nursing instructor functioning in this capacity.^ then the student will be 
receiving conflicting messages, i,e,, "do as I say, but not as I do," 

Because performance evaluation .in clinical settings is suc^ a highly 
compleK process, one might ask: "Why not use simulated experiences to 
offset sortfe of the complexities?" Simulated experiences are of value in the 
assessment of some aspects of the competencies expected of nursing students. 
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well-structured simulated experiences can provide information relative to the 
application of clinical knoMedge by students. However, performance in the 
' clinical setting using carefully selec'ted cl'ientB whose care would serve as 
stimuli to elicit behaviors required to be assessed for students has the 
potential for a higher level of, .validity . The element of control possible in 
stimulated experiences reduces the uriplarined-for aspects .Which normally., 
comprise the real life situation. 

; The clinical setting is a changing, evolving situation. Client care in 
the clinical setting; involves planning for and dealing with factors that can 
be anticipated and dealing with factors that develop within the situation 
which cannot be specifically anticipated. The holistic approach to care, 
rather than the task-oriented approach, is used by the nurse wh^ focuses on 
those procedures or technigties/ required to satisfy specific client needs. 

Learning and practicing farooedural aspects are important in the edu- 
cation of nursing students. /These aspects may be aearned and evaluated more 
economically in a simulated/setting, e.g., the classxoom laboratory. ^ The 
evaluation of procedures can be accomplished by the use of a simple checklist. 
The checklist could be ooiposed of the important critical components related 
to the. safety and effectiveness of the procedure. A determination could be 
made with the checklist /as to whether- or not the student's performance 
reflected the critical /components of the procedure. i 

The view of variods methods used to gather information about students' 
competencies depend o/i faculty values and value systems. The learner and the 
instructor are affeoited by the intrinsic and extrinsic factors. Figure 3 
illustrates the interrelationship of aspects of the affective domain in 
situations involvifig the learner and teacher. 
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Figure 3 . 
INTE^ELATIONSHIP OF ASPECTS OF THE AFFECTIVE DOMAIN IN SITUATIONS 
INVOLVING THE LEARNIR AND TEACHER IN A ONE-TO-ONE MLATIONSHIP 
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value systems 'are the products of life experiences. Value systems aan 
change over a period of time. It is possible that an individual's concept 
.of personal values may prove to be inaccurate in some situations. A person . 
may believe that a specific value has been incorporated; however, in some 
situations inconsistency between belief and behavior may result in functioning 
at a level quite different from the one imagined.. One's. value system might 
be representative of a variety of levels, in terms of the categorizations of 
the affective domain. It is important to be aware of this when working with 
students in the clinical setting. 

PBRSPECTIVES ON EPUCATIOMAL EVALUATiON IN NURSING 

There is a hierarchial level of educational objectives in nursing, 
progressing from curriculum objectives to course Dbjectives, and finally to 
the objectives of learning experiences. Figure 4. relates aspects of the 
curriculum development'..process to the what, who, when, why, where, and how ^ 
aspects of the evaluation process. ' 

Level objectives focus on the "who," the "what" and the "when". Faculty 
are dealing with the nursing studenV .^t intarin, ,>oints in the program, not 
at the end of the, program. The designfttx,. Jt uim behaviors at a particular 
level reflects the content of the .b«haviors in the expected terminal outcomes 
of the program but, ' in general they reflect a different degree or extent of 
attainment. The course objectives focus, in general, on the "what" of 
evaluation. It is not that the other componenfcs are not important, but 
greater emphasis is given to the "what" in terms of the. total curriculum. 
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Objectives of learning experiences include behaviors representative of the 
, cognitive, psychomotor and affective realms .of behavior. A paper^and-^pencil 
test could be used to measure attainment of the aspects apecific to the 
cognitive domain as well as the cognitive aspects ^related to the psychoiriotor 
and affective behaviors for the course. " \ 

,. A variety of tools and techniques^ in addition to written tests and 
performance evaluation tools / are necessary to obtain evidence of achievrment 
In relation to the multiple facets of the objectives* . 

-■ • ■ J" ■ 

Figure 14 

ASPECT ? ' OF THE EVALUATIVE PROCESS ' . 

IN EDUCATIONAL PROGRAMS 
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Figura 5 helps to clarify the relationship between the behavioral 
components of Gourse objectives and evaluation methods. Sample evaluation 
methods include a variety of tests, reports, group projects, ^rt^^ the three 
major aspects under performance evaluation — observation, oral GOmmunication, 
and written coiranunication* " 

The prinGipal tool of Glinical perfdrmance evaluation, observation, does 
not lend itself to the degree of precision that is possible in theoretical 
evaluation with the use of written tests. There is no substitute in cliniGal 
performance evaluation for direct observation of the actual behavior of 
individuals over a period of time, .However, observation must be purposeful 
to be meaningful. Each evaluator must be thoroughly familiar with the 
previously agreed-upon objeGtives, qualities, behaviors or abilities which 
are to be evaluated, the previously determined criteria or standards for 
judging levels of performance, and the kind of behaviors that^ will demonstrate^ 
most clearly the behaviors to be .evaluated. 

Faculty agreed-upon objectives and criteria that are well-defined and 
clearly stated provide the basis for purposeful and consistent observations 

in performance evaluation. These help to minimize the effects of biases and 
^ ; \ . ■ ' 

special interests of the faculty. 

The reliability of observations is directly relattd to their frequency , 
One example does not necessarily warrant a general conclusion; however, 
neither does a specified number of ^observations assure the required com- 
petence demonstrated should be the most deciding factor. 
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. - Figure 5 
SCHEMATIC .REPRESENTATION OF' THE EVALUATION OF 
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ftmong the factors contributing to the establishment of levels of com- ■ 
aetence for student perforinanca, for courses, and for levels in the program 
are the sequence of course, course emphases, the student rotation pattern, 
the health status of clients used for student experiences, and the roles 
for which the nursing student is being prepared. 
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- pavelopmetit' of a Bluaprint for the Assessment of Clinical Objectives 
Figure 6' reprasents a possible approach to the development of a/blueprlnt 
for the assessinent of clinical objectives. The vertical axis of the grid 
could be used to list the objectives derived from behaviors stipulated in 
the objeetives for learning experiences and related to the performance 
components of the objectives. The horizontal axis of the grid could be used 
for the content reflected by the objectives for learning experiences and 
related to patient/client care. Systematic planning for the assessment of 
the performance of nursing students * using the afDrementioned grid, could, 
also be used as a guide for the course as a whole in addition to planning for 
the assessment of individual nursing students* 

CONCLUSION 

Clinical performance evaluation is a complex process involving problems . 
that can be controlled with valid and reliable" eyidence about the achievement 
of clinical objectives by nursing students* There is no one tool that is 
applicable to all nursing programs since each program is unique. Although 
two programs establish exactly the same objectives , the needs in terms of 
each program for a clinical evaluation tool will differ, . Effective evaluation 
depends on a high level of congruence between the framework of the curriculum 
and the techniques established to assess outcomes at various levels in the 
program* In addition, there must be a high level of agreement by faculty 
regarding the behaviors to be assessed and the standards . or criteria to be . 
used in the assessment process. , 



48 



ERIC 



Figure 6 

SLUEPRINT FOR THE ASSESSMENT OF CLINICAL OBJECTIVES 
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The following approach can be used to reduce the element of subjectivity 
inherent in clinical performance evaluation and to increase the reliability 
and validity of the process i 

. 1, Identify specific components of course objectives basic to 
the developruent of perfprmance objectives in the clinical 
setting. 

2. Identify and define the distinct observable behaviors that 

are essential to the achievement of the performance objectives. 

3. Describe in behavioral terms the criteria or standards that 
will be used in judging levels of performance relative to 
each of the expected behaviors, 

4. Identify specific nursing actions that illustrate established ^ 
levels of performance as described by the criteria for each 

of the eKpected behaviors, ^ 
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Clinical Performance Evaluation 



PRINCIPLES OF PERFOWmNCE EVALUATION 



Sonie general principlee of performance evaluation are basic to Glinical 

evaluation^ These principles include: 

! _ • 

1. Perfqrmcmce evaluation ia aonaemed with hau) a person funations 
in 'i^^^s^&aifia Betting, 

The more complex the setting or activity^ the more complex 
' and difficult will be the process of evaluating the indi* 
vidua! 's performance.. 

2, P^rformcmae evaluation involves judgmmntB md interpretations. 

Evidence relative to each aspect of the performance to 

be evaluated is necessary for valid decision-making. 

An approach aimed at reducing subjectivity and maximizing 

objectivity is basic to valid judgments and interpretations. 

3^ Performanoe evaluation requiree knowledge of what is to be 
evaluatBd, 

The 'more one" knows about what is to be evaluated ^ the 
more penetrating and the more valid the evaluation is 
likely to be. 

4. P&rformanae evaluation involvea Qharaateristio ^ meaBurable 
aspeats which will serve to distinguish differ&naBs in 
quality or levela of performanaen 

Behaviors identified should be specific and unitary. 

5. Performanae eval^a^ivH^invol^es cmsidevation of varying levels 
of p^fpjsinGmae7~ ' ^ j 

6* Performanae evaluation invokes aompariaon with previously 
deternrCned^ appropriate criteria or ^^ndarda. 
Established levels should represent reasonable 
pectations at specified labels of ability* 

f 

! 

APPLICATION OF PRINCIPLES = ' - ^ 

. Performanae evaluation is aonaemed with how a person funations in a 
speaific setting, , ?■ 
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The clinical experiences of nursing atudents occur in a variety of 
settings,- atudents are expected to develop and demonstrate many roles. 
Haalth-care services in nursing encompass a wide variety of health-care needs, 
in a variety of settings, covering the age span from birth to death. Goals 
for services to clients includei health promotion and disease prevention; 
health maintenance and health restoration ; rehabilitation,- and comfort and 
ease when body defenses can no longer be supported, 

Ferformanae Evatuation Involves JudgmentB and Interpretations. 

Judgments and interpretations introduce the element of subjectivity not 
only in th'e process df evaluation, but also in the selection of experiences 
to be used- for the learning and evaluation of students. Unlike evaluation of 
the theoretical component in which test questions can be developed and 
tailored, to reflect emphases of specific content areas, the clinical component 
depends upon the selection of clients and is more nebulous. Decisions by the 
instructor regarding the kind of client situations that will pi.-ovide appro- 
priate learning experiences require judgment at a level that is different 
from that in the evaluation of the theoretical component. The process is 
more complex. 

. Performanae evaluation requireB knowtedge^ of what ia to be evaluated. 
Observations made of students in a specific clinical area are more 
likely to be accurate if made by instructors who are specialists in th-? area, 
and who are experienced in the evaluation of students. For example, the, 
medical-surgicai specialist in obsurving students assigned to assist clients 
"with medical-surgical problems is likely to make more meaniniful observations 
than the maternal and child specialist ■■observing these students. This does 
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not imply that the person whose area, of specialisation is Tnaternal and child 

'f 

care will ba unable to focxm on the general meaning of the objective. 

Rather, the specialist in iaedical-surg:^ jal nursing will be expected to have 

greater knowledge of alien': needs, ?nd able to make an assesament of the 

ability of nursing students to satisfy the requirements set forth in the 

objectives being assessbd, 

FerformarLoe evaluation involves Qharaaieristia^ m&a3ui'abt& aspeots 
whiah will servm to distinguish diff&rena&s in quality or levels of 
^ pei^forrr.ance^ 

Behavioral statements which reflect action that can be interpreted in 
more than one way will require validation by the evaluator, . There will be a 
need to find out the rationale for a specific action from the person being 
observed. This is an essential aspect of performance evaluation* 

In reviewing some of the perfarmance evaluation instruments, one 
occasionally finds a listing of behaviors such as "understands the basic 
sciences" or "applies principles of the basic sciences." Unequivocal assess-- 
ment of these statements would not be possible by direct observation. 

For example, if an inr-'tructor observed a first-level nursing student 
administering a cleansing enema and noted the nursiny student adjusted the 
reservoir of fluid so that it was no more than 18 inches above the level of 
the client's anus, all the instructor can surmise at this point is that the 
student carried out the procedure in accordance with the specifications for 
the procedure. The instructor does not know for sure that the student was 
appiying the appropriate physical principle related to the effect of the 
height of a colunm of fluid on the pressure of the fluid as it is introduced 
into the lower intestinal tract* However , if the instructor, asked the' student 



about her reason for aajustment of the level of the reservoir, and the 
nursing studf^nt identified the related physical principle, than, and only 
then, can an instructor be sure that the student was- applying the related 
principle in this particular situation. Therefore, we cannot attribute a 
correct action as an application of knowledge unless steps are taken to 
validate the knowledge. Without proper validation, in the aforementioned 
situation, the only objective that can be satisfied is "carries out 

procedures correctly." 

'J 

Application of knowledge can be measured best by a test item. The 
development of such an item is not as easy as one would believe* For iri^ 
stance, to determine whether a multiple-choice test item is at the cognitive 
level of application, it is necessary to eKamine first the alternatives of 
Qptions to see if the examinee can answer the question correctly by simply 
recalling the concept to be tested, or whether , the concept is presented in a 
new way/ A pertinent question to ask ih the assessment of alternatives ±31 
"What is the least amount of knowledge an examinee will need to answer the^ 
question correotly?" Who is to say what the most knowledge is? What do 
we know abQUt the cognitive styles of individual examinees? Since' this type 
of information is generally unavailable to instructors, the most valid 
decision is based on the least amount of knowledge rather than the most. A 
concept will have to be presented in a new way for tho^ examinee to demonstrate 
application of knowledge* ^ < ■ ;'i 

An action or a response must not be interpreted as the outcome of a 
higher mental process if it caa be interpreted as an outcome of one, lower on 
the psychological or performance scaled It is therefore necessary to examine 



carefully the objectives in tha preformance evaluation tool and teat qufstions 

in the theoretical . evaluation to determine whethGr application is truly being 

evaluated or measured. The use of paper-^and-pencil tests is a more reliable 

means of measuring knowledgG. 

It is important in nursing education programs to assess whether students 

can analyze patient care situations and pull related knowledge together to 

provide for the identified needs of patients* Guarding against comparmen"- 

talization of knowladge needs to be given special consideration in both the 
~' . * 

learning and the assessment processes. The "putting together" of concepts r 

^1 ■ • = 
with emphasis given to the relationship between concepts^ must be a part of 

both the learning and the assessment processes. This must be an on^going ac^ 
tivity throughout eac for the integration of knowledge to be realised. 

Mager (1962) focuses upon the importance of the specificity of objectives* 
Specificity and ambiguity can be regarded as a continuum. In view of this, 
instructors might ask: ''Is there a point at which objectives can be too 
specific?" This is a possibility, Many specific, uncategorized objectives 
contribute to fragmentation in both the learning and assessment processes. If 
students are expected to regard client care holistically and to integrate the 
various related aspects to client care, instructors may undermine the achieve- 
ment of these expectations by using a tool for performance evaluation which 
includes many uncategorized and often overlapping objectives. The correlation 
of related objectives will enhance the students' ability to integrate related 
concepts^ and will provide for more effective and efficient tools for the 
assessment of clinical objectives, . 

P&rformanae evaluation invoLves aona'idemtion of varying levels of 
performanQe. - 
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The varying levels of performance should represent what the faculty 
believes to be reasonable expectations for varying levels of ability at 
speqified levels in the program. If the levels of ability to be used for 
the assesament process in performance evaluation are eKcellent, good, average, 
and poor, or if letter grades A, B, C, and D are used, specific standards 
or criteria must be. developed for each level of ability* 

There is a real value in reducirig the nun^er of levels or standards to 
satisfactory and unsatisfactory, or acceptable and unacceptable to use 
criterion-referenced anchors. However, this alone will not solve the problem 
of ai^iguity. If the unsatisfactory or unacceptable criterion beha^^iors are 
stated as direct negatives of the satisfactory or aeceptable behaviors, 
insufficient information will be provided. 

To promote the clarity of the^ unsatisfactory statement, it is necessary V 
to know specifically what the student either did or did not do. Why was the 
behavior inappropriate or unsatisfactory? All aspects? Some aspects? For 
example, the following statement provides little information for effective 
evaluations "Does not carry out technical aspects of effectively." 

Another problem that arises with the use of satisfactory and unsatis- 
factory as anchors is related to the exact meaning of the terms. "Satis- 
factory" can mean aver^: performance, based on an instructor ^s determination 
of eKpectations for students functioning at a ■*C^^ levels or '-aatlsf actory^- can 
mean passing, based on an instructor *s determination of a minimal level of 
performance. These are entirely different concepts of "satisfactory," If, 
perchance, there is not faculty agreement as to "the exact meaning of the term 
for a particular program, tnen, unintentionally, each instructor might use 
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an entirely different base for the assessment process^ resulting in an 

inf ringament on the validity and reliability of the assessinent process. 

Performanae evaluation iniwlveB oonparisan with pr&viouBly d&t&mdned^ 
appropriat& ariteria or standai'dB, 

This is the crux of the problem in performance evaluation. Standards # 
like test norms, should be appropriate and realistic for the group being 
.evaluated. Faculty agreement is essential. 

GUIDING PRINCIPLES IN EVALUATION OF CLINICAL PERFORMANCE 

Two concnpts^ especially important in the clinical evaluation of nursing 
students , arei 

(1) Evaluation should be based on accomplisliments directed 
toward the philosophy and objectives of the program. 

(2) Evaluation should be related to nursing students' achieve- 
ment of stated objectives in terms of established criteria. 

There should be a direct relationship between . performance evaluation 

tools, the behaviors delineated for appraisal, and the curriculum framework.. 

An evaluation tool that does not reflect the philosophy and^ curriculum 

framework can hardly provide data needed for decisions in relation to edu^ 

cational improvement. .A unifying framework provides the basis for an 

organized way of looking at growth and attainment from one level to another 

in the curriculum. If a unifying framework is used, it is possible to 

determine more reliably and validly whether progressive change has taken 

place in the important areas that are common to courses throughout the 

curriculum. Performance evaluatioh tools which include entirely different 

behaviors from course to course and from year to year negate the whole idea of 

progression in learning as well as make meaningful decisions difficult or 

impossible, ^ i. 
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Approach to the Development of a Tool Which Refle cts the Currlculuni 
Framework^ , ' 

The following approach may be useful in developing a clinical evaluation 

tool t 

1, Review the horizontal and vertical components of the Gurriculuin, 

2, Identify from the horizontal /components one that can, by virtue 
of its con^rehenaiveness, serve as the basis for the modal for 
the performance evaluation toolp 

3, Determine the major behaviotal categories to be used for the tool, 

4, Referring to the vertical components and to the horizontal com-- 
ponent selected for the framework of the tool, determine sub- 
system or subset behavioral categories under each major category. ^ 

5, Determine for each course behavioral expectations related to 
the subset or subsystem /categories of behaviors, 

Use of Tools for the Evaluation of Clin ical Performance Evaluation 
of Nursing Students . 

h variety of tools are necessary to evaluate the outcomes of education 

' / ^ - 

in nursing. Outcomes related' to synthesis and problem-solving require tools 

other than those centered on; observation. Nursing care plans, patient gc re 
studies, process recordings, and nursing diaries are samples of tools and 
techniques which are important to include in the evaluation of aspects of th- 
'clinical component of nursing. 

The validity of process recordings or nursing diaries can be affected by 
the level of trust engendered by the insUructor/ For example, if a student 
does not perceive that a trusting relationship exists between herself and the 
ins^ctor, how truthful ifi the student likely to be? Will the student identify 
areas of strengtKs and areas of weakness? Will the student be as honest as 
she might be in recording exactly what happened in her interactions with 

patients? ' . 
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If the nursing student is expected to use perforinanGe evaluation tools 
for self ^evaluation and discrepancies occur between the student's assessment 



and the assessment made by the instructor, how Are the discrepancies handlGd? 
What type of guidelines are needed to deal with such a problem? These are 
just a few questions that need to be considered in the use of the performance 
evaluation tools by students for self-assessment. 

PROBIiEMS OF PERFORMANCE EVALUATION 

There are coiranon and persistent complaints leveled ut methods of evalua^ 

tion of the performance of nursing students, and they add up to an absence of 

the four major criteria of a good rating of performance^ The complaints arei 

1* Laok of vapidity . The tool does not measure what it is in ^ 
tended to measure on the ratings alone j therefore, it would 
not be possible to predict accurately how the individuals 
would behave in terms of relative strengths and weaknesses 
or in comparison with other individuals , 

2. Laak of reliability . Comparable results will not be obtained 
each time the rating device J s used under comparable 
circumstances^ ' 

3. Laak of Objectivity . Findings or ratings are open to a 
variety of interpretations by different evaluators. The 

* procedure provides few, if any, safeguards against these 
individual interpretations^ 

4. Laak of praQtiaality . The method is too time-consuming and 
complicated, involving more time spent in filling out the 
form that in observing the performance , of the 'individual, 

A REVIEW OF COMMON BEHAVIORS 

A number of questions can "be" asked concerning the meaning of stated 
objectives and how the bbjectives reflect, correctly or incorrectly, faculty 
values and beliefs. Consider the following four objectives, ^(Lynch, 1978 1 10) i 
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1. "Pormulates appropriate and realistic goals for clients," 
(J^urse-oriented goals, or nursa-client-^oriented goals? 
Appropriate to or for whom? Realistic to or for whom?) 

2. "Solicits and uses suggestions." (Must a person's request 
for inforination or assistance always be followed by precise 
use of the information?) 

3. .Accepts criticism gracefully. (Is a value judgement 
implicit in the statement?) 

4. "Respects the dignity and uniqueness of the client." (How 
can this behavior be made operational?) 

Review the following behaviors in terms of four components subject, 
behavior, specified conditions, criterion i 



1. Comruniaation skills, i.e. .. listming (Topf , 1969) 



Effective B ehavior 

-—^ — ^ , ; 

Waits out silence or allows 
patient to fill a pause. 



ineffective Behavior 



Fills silence with own talking. 



Interrupts patient unnecessarily. 



Allows patient to express 
an idea before making a 
suggestion. 



Makes a suggestion before patient 
has been all6v;ed to express 
himself. 



Indicates by brief, rele- 
vant conmient that what the 
patierit has said is under« 
stood , 



Withholds indicating to patient 
that the nurse understands what 
the patient said. 



Summarizes what the nurse 
thinks the patient has said. 



2. Lsaderahip skills (Wandelt, 1975^32) 
Demonstrates Leadership Ability 



Invites suggestions from members of group. 



b. 



Gives recognition to achivement of individual members 
and to that ,of group as a whole. 
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c. Offers instruction and guidance when proposing a different 
way of doing things, 

d. Encourages members of group to express likes and dis^ 
likes and to choose portion of work they would like to ^o, 

e. Assists group to evaluate work accomplished and plan con^ 
tinued work* 

3, Critioal Thinking (Gronlund, 1976 i 62) 

Demonstrates the Ability to Think Critically . 
Distinguishes between facts and opinions. 
Draws valid conclusion from given data. 
Identifies assumptions underlying conclusions. 

Summary 

The integration of theoretical concepts in clinical evaluation requires 
careful planning, systematic ongoing evaluation ^ and a commitment to specific 
beliefs about performance evaluation. The evaluation of performance is a 
highly value= laden entity in which the person being evaluated learns much 
about the evaluator in the process. Conflicting messages can be given when 
there is a discrepancy between concepts identified as being significant and 
the instructor in a clinical setting demonstrates either a lack of focus, or 
a disparate focus. If problem-solving^ the development of creative abilities 
functioning in the role as a^ patient advocate, and the functioning as a cnang 
agent are important, adequate opportunity must be provided for the nursing 
student to be involved in activities which will foster the development of 
skills and reinforce learning, 

>i I--" 



The ^valuator must be capable of demonstrating positive behaviors during 
evaluative procedures. Some of these positive behaviors arei 
Anticipation instead of anxiety i 
Encouragement instead of defeatism; 
Reward instead of punishment 

Confidence instead of mistrust; . 
Satisfaction instead of displeasure; . 
Trust instead of uncertainty i 
' Honesty instead of dishonesty; 
Freedom instead of restraint i 
Risk-taking instead of safety; 

^ 

Self-determination instead of compliance; 

Growth instead of stagnation or regression. 
■ The evaluator inust be able to use opportunities ih the clinical situation 
for the clarification of valuis and the growth and development of students. 
Consider the situations below that might occur in either a pre- or post- 
conference session and the Associated responses in terms of value clarifica- 
tion and the growth and development of the nursing student. 

■ Situation Response 

^ Student reports that a particular Have you considered any alter- 

intervention did not produce the natives to the measure that you 

effect anticipatedj used? ^ 

Student states' that the care of Is it just this patient, or have 

an elderly, incontinent "patient ^ you felt this way before in^^ 
is distasteful to her. providing care for other clients 

and patients? . 



SltuatlQn 

Student arrives at a nursing Is your diagnosis consistent 

diagnosis- which is inconsistent with the data obtained about 

with the information gathered the client? 

by the student during the 

assessment phase of the nursing NOT 

process. 

How could you 
You are aware 



'Hopefully,, each instructor will be able to provide learning experiences 
in clinical settings that are growth^promoting for ./irsing students, 
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REPORTS FROM SPECIAL INTEREST GROUPS 

Teaching and Learning Styles 
Janet Awtrey, Delols Skipwith, Kathleen Goldblatt 

BACKGROUNP INFORMATION 

As the task force ^ composed of seven representatives from the TTniversity 
of .Alabaina School of Nursing in Brimingham^ broached S^B's assignment to 
develop objectives for our school's project^ the philosophy underlying the 
curriculum was reviewed , Some of the phrases which seemed paramount to the 
project included! man is uniqua, unified, valuing, and constantly interacting 
with his environment? man strives toward self ^aetualization, Society influences 
individual behavior i learning is a continuous lifelong process through which 
the individual changes his behavior; learning occurs through active participa^ 
tion ^In the learning process and results from the integration of cognitive, 
affective, and psychor;otor eKperiances; the faculty "S role is to provide an 
environment which proniotes utilisation of the le'arner^a unique abilities, 
experiences, and level of motivation; and, finally, efficient and economicar 
learning requires concepts formation which promotes effective utilization of 
knowledge in nursing practices. ' 

From this analysis, the task force decided thai: it was incumbent upon 
faculty to. assist the individual student in developing in the cognitive, 

i . ^ = . ' 
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affective, and psychomotor doiTiains> Further, a variety of teaching styles 
must bu employed. The question, however , dealt with which style of teaching ^ 
is appropriate for a specific individual student. This question became the 
focus of our project, ^ ■" 

The second major decision facing the task force was to define the tenri 
"non^traditionai" student. The "non-traditional" student- was defined as any 
transfer student, excluding registered nurses. Approximately 60 percpne of 
our student body is composed of transfer students, primarily from two-year 

i 

ins ktutions. The task forue proceeded on the assumption that the environment 
in a two-year institution is different than that of a senior college in 
student numbers, teaching methods, and eKpectations of students. It was a. 
general consensus that a change in the ^ learning environment and the corollary 
requirements when entering a senior college impeded rtudent learning. 
. . Once cognitive mappi^^f . learning styles was chosen as ^the vehicle via 
which individualized instruction could be promoted, the task force identified 
the following objectives: to establish within a nursing education. curriculum 
the use of cognitive maps with non-^traditional students to (1) diagnose 
learning problems? (2) recogniEe, respect, and adapt to culturw I differencesi 

(3) present instruction appropriate to the 3 earning style of the student? 

(4) identify learning obstacles; and, (5) prescribe alternative learning 
strategies. It was agreed tliat the project objectives for the school coincide 
closely with those of the SREB project. 

Three workshops have been conducted by Dr. Ronald Bass;, Coordinator of 
Learning, School of ^Dentistry , University of Florida in Gainesville. The first 
workshop aimed to acquaint faculty with the concept underlying cognitive mapping 



66/ 

/ 68 



The objectives were as follows s (1) define the term "The Educational 
Sciences/' (2) define the tem "Educational Cognitive Style/V (3) list the 
two main sections of "Symbols and Their Meaning/- (4) list the three areas , 
of "Cultural Determinants," (5) read and interpret individual cognitive style 
of others, (6) observationally map the cognitive style of others, and p) pre- 
scribe instruction based upon information contained in a cognitive style map. 
Several weeks prior to the workshop/ faculty completed a questionnaire to 
provide information for Dr. Bass, Aft^r thg workshop, faculty v^ere encouraged 
to read and seek discussion sessions with any of the meir^ers of the task 
force. Additionally, each membe.^ was challengect to attempt to observationcdly 
map students, particularly those wno seemed to have difficulLy in achieving 
satisfactorily. The outcomes of the first workshop were raising the faculty's 
av;areness about cognitive mapping' and providing a mechanism for more stringently 
^ons id faring the learning needs of each individual student. 

The second campus workshop centered on the application of basic content 
presented in the first workshop* Workshop objectives were based on cognitive 
educational styles and stated that participants will be able to (1) prescribe 
didactic instruetioni (2) prescribe clinical instructional procedures; (3) 
analyse instructional materials for elements required for the student to be 
successful in interaction with the materials; (4) predict student success or 
difficulty in clinical procedures from cognitive style mapsi and (5) prescribe 
strategies for augmentation* , 

Prior to the second workshop, Dr. Bass viewed and mapped at least ten / 
different videotapes or slide presentations used in the school for teaching 
purposes. As part of the workshop, participants chose a media presentation 
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to view and map. Thif; active participation sar/ed as a stimulus for faculty 
artd added realism to the workshop. 

Before the third workshop, the tadh force agreed that to enhance the use 
of cognitive mapping and to help faculty realize the need for such a vehicle 
in the teaching procese, a longitudinal research study with students was 
necessary to provide baseline data. It was the consensus that all students 
be included, with a portion of the study focused on the non-'traditional 

studient, ■ • * , 

The purposes of a research study are as follows i (1) to identify if 
there are differences in the cognitive maps of transfer and non-transfer 
studentsi (2) to determinp if there is i difference between those nursing 
students who successfully complete each lev^l of the curriculum and , those 
who donoti and (3) to identify if thero is a pattern of cognitive mapping 
compatible ./ith succesFful completion .^f th^ school of nursing curriculum. 
The data obtained from the study will help in making sound judgments regarding 
' the use of cognitive mapping. The study does not supply information strictly 
for the accomplishments of the BBEU project ger .^i it provides^a mechanism 
for curriculum evaluation fay determini.ng how, whan, or if students' learning 

styles change* , . 

To answer the study questions for the research project, the quept .onnaire 
for the development of a cognitive inap of learning styles will be administered 
to students as they begin and complete their first clinical ^nursing sequence 
during Level II (sophomore year) , again when they complete Level III (junior 
year) and, finally, when they complete Level IV (senior year) . Data wxll 
then be analyzed to answer the study questions. An additional bonus in this 
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*type study is that students' maps will be available for interested teachers'' 
use. Students are. aw^re that teachers may see their maps and discuss them • 
at prearranged sessions* Human use protocol has been written, and the 
Institutional Review Board of the University has granted peraission for the 
study to be conducted, 

Th% third campus workshop was recently conducted by Dr., Bass, The 
objectives of the workshop were as follows i Given a teaching style map, 
the map of a piece of instruction, and three student cognitive style maps, 
the workshop participants will predict (1) the potential success of each of 
the students in interaction with the teacher; (2) the potential success. of 
each of the students' interactions with the piece of instruction! and (3) the 
augmentation procedure for each of the students. Emphasis was placed on 
each faculty member manipulating content to determine the interface of the 
students* learning style and the teachers' teaching style, 

: It may be worthwhile to note tnat all. required information for the three 
workshops for awarding continuing education credit was submitted to the 
Alabama State Nurses' Association, The awarding of CQntinuing education . 
credit gave faculty a feeling of reward 'for the additional work required for 
the campus workshops* ' . ■ 

•The^task force does not envision that every faculty member will adopt 
cognitive mapping i however, it is anticipated that sufficient interest has 
been generated to provide for diffusion of enthusiasm about cognitive mapping 
throughout the faculty over a period of time. 
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LEARNING STYLSS • ' ' i . 

' Much emphasis is placed on the role that cognition plays in the teaching 
and learning process and' manipulation of the same for graater dividends in 
education. How does an individual come to know, i.e., learn? How does' a 
teacher teach? Is what is learned a function of innate ability, environmental 
factors, the nature of the subject matter, or interactions between student 

and teacher? what are the intervening processes between not knowing and 

' ■ ■ ■ ' ■ . - 

knowing? The concept of cognitive style sheds some light on understanding 
learning* Examination of the term will help establish a framework for under- 
standing the concept within this paper. The word' "cognitive" is a derivative 
of the term cognition, defined by Webster as the act of or process of knowing. 
Style is a term used some four decades ago by Allport (1937) to describe, 
consistencies and patterns demonstrated by individuals in their daily 
activities. Another view of the term "style" is that it is the characteristic 
approach to a variety of situations. 

The literature (Coop ^ Sigel, 1971; Dressel, 1976; Witkin, 1974) generally 
refers to cognitive style as /the stable, consistent, yet distinctive pre- 
ferential manher in which individuals approach learning, organizing and 
processing information, and problem solving. Various uses of cognitive style 
show that the concept grew out of the fields of psychology and education. 
Its value lies in the understanding of hijman behavior and personality, the 
issues of intelligencer ability, performance, academic aptitude^ prediction 
of success in various disciplines, the selection and placement of students, 
and utilization of various teaching strategies. 

Various dimensions of cognitive style have J; ^en identified in the 
literature. Field independence-dependence as developed by Witkin et al (1962) 
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is one dimension of ^^gnitive style frequently encountered in the litera.ture* 
Field dependence as a concept exists on a Gontinuuin, Field independence is 
the ability to select relevant stimuli from the larger context and experience 
items as separate from the surrounding fields. In the field dependent 
diinansion/ the person's perception is strongly dominated by the field — items 
cAnnot be separated from the field, and there is fusion of the content of 
the field . , 

The second dimension, that of leveling and sharpening as developed by 
Gardner (1959) , contrasts simplicity of the cognitive field with complexity 
and differentiation/ such as similarities and differences, 

A third dimension, studied by Kagan, Moms, and Sigei (1960/ 1963)/ is. 
that of descriptive-relational and categorical cognitive style based on 
grouping and sorting behaviors. Cut of their work came the concepts of 
reflectiyity and impulsivity* 

The cognitive style dimensions of conceptual versus perceptual-motor 
dominance and strong versus weak automatiEation weiqe offered by Broverman 
(1960) . . . ' 

The essential characteristics of cognitive styles are process-content/ 
pervasiveness/ stability/ and neutrality (Witkin et, al., 1977, p,15) , Cognitive 
styles are concerned with the process rather than the content or "what" aspect 
of cognitive activity* It is the how we perceive/ think, solve problems/ or 
interact with others. The pervasiveness of cognitive style is exemplified 
in the fact that it is a feature of personality and cognition and can be 
assessed by verbal and nonverbal (perceptual) methods. 



The stability of cognitive style is demonstrated by the fact that one can 
predict with reasonable accuracy that a person's partioular style will remain 
the Bame over a period of time, even years. The paradox of this is that- styles 
are changeable and that an individual can switch from one. style to another. 

There is nothing good or bad about a certain style, for a style may be 
suited differently for different cireumstances and no one map is better than 
another but points out assets and liabilities. .This characteristic of 
cognitive style is known as neutrality. 

NOW that a frame of reference has been established, the focus of the re- 
mainder of this paper will be on the use of this concept in an educational 
setting. 

UTILIZATION. OF COGNITIVE STYLE MAPPING 

The framework of cognitive style mapping, as developed by Nunney and 
Hill (1972) at Oakland Community College , was used in this project. The 
assumptions underlying this concept arei (1) man is a social creature wi,:n 
a capacity for deriving meaning out of his environment and personal exper- 
ience? (2) man uses symbols in his search for meaning; and (3) these symbolb 
acquire meaning through man's cultural experience. 

An individual's map is determined from the individual ' s responses to a' 
series of questions rt. u.gned for this purpose. A cognitive styl--' map is 
divided into four categories, namely theoretical Rymboi'^, qualitative symbols, 
dultural determinantw, and modaJ-ities or interence. . • 



^Meaning will be found on pages 82-83, 
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After participating in the second campus workshop, one of the nurse 
educators/ DelQis Skipwith, chose to use cognitive style mapping with a 
selected group of students during the suimer quarter? 1978. The purposes of 
this endeavor were twofold i (1) to implement some of the infomation and 
skills gained from participation in the faculty development workshop, and 
(2) to gain additional information about students in this mental health target 
population which would enable the mental, health faculty to improve taachlrig 
and learning strategies. 

= Fourteen students enrolled in Professional Nursing Conce^itration - Mencui 
Health Nursing, a senior level nursing course designed to provide students 
with additional theoretical and clinical experiences in a selected area, v/ere 
invited to participate. All of the studentfs had completed one course in 
psychiatric nursing and were enrolled in this course on the basis of s/^lf 
selection and/or placement at the senior level. The seminars are held 
weekly. Each student is rerjponsible for selecting a topic , getting faculty 
approval of the topic, and presenting the topic a seminar meeting. The 
focus of the seminar is on nursing interventions and research in a r.pocific 
area of mental health. The faculty member serves as a resource person and 
facilitator during the seminar. All students in the seminar are expect:*^.d to 
participate. Pre-^determined objectives and overall seminar guidelines are 
used by the faculty and students in. evaluating the experience - 
^^^^^^^ student was given a copy" of the cognitive style map to complete. 

The returned answer sheets were sent to the consultant, Dr, Ronald Bass, for 
determination of .the map. Twelve of the fourteen students returned the 
completed maps. The group consisted of two white males ^ nine white females 



and one black fema],e. The group included one transfer student froin a junior 
college, one who had attended two senior colleges in addition: to a junior 
college prior to enrollment in our nursing program, and two registered nurses. 
Although this prujeat site had identified the non-traditional student as the 
transferee from a junior college, review of ^some of the characteristics, of 
this group revealed a heterogeneous group of various sorts of "non-traditional'' 
student, i/e. , age, sex/ race, prior education, and generic- or registered 
nurse students. 

Teaching strategies utilized in the seminar ^included i group discussions; 
Vmodified*' lecture; use of films, videotapes and audiotapes; guest speakers; 
and review of various sources of literature." Among the topics discussed 
werei "The Abusive Parent and Child Abuse," "Loneliness and the Elderly, 'V 
"Spouse Abuse," and "Adjustment Reactions of Adolescents." 

The results of the coghitive style mapping for the 12 participants 
indicate that ^his particular group of students demonstrated a preference 
. for group discussion, lecture format of teaching, working with numbers, and 
reading the written word. The teaching strategies employed were correlated 
with the first and last preference , of these students. Howevep, opportunities 
to learn from working with numbers was minimal, except for discussing the 
results of various research studies. This finding does:raise the question 
as to what can be done to maximize this quality. Can and should greater use 
be made of . statistical findings of research in mental health and the issue 
of vital statistics and epidemiology? 

The use of the sensory modalities in learning by this group of students 
is particularly encouraging in view of the emphasis placed on verbal and non- 
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verbal behavior In this Glinical entity. The Q(S)- (meaning through sense 
of tast6) is interesting inasmuch as aleven students showad this quality. 
There' are few opportunities to approach learning of materials through the 
sense of taste in this clinical entity or other areas of nursing. Perhaps " 
this quality can be capitalized on in helping students develop a more em- 
pathetic attitude with clients in regards to nutrition and the use of bertain 
medications. 

The qualitative syn^l of Q(F) was listed on the maps of eleven students. 
This symbol is identified as the ability to combine two or more senses. This 
^ quality .should be given continued support especially for enhancing assessment 
or collection of data skills.^ ^ ^ 

As the qualitative symbols associated with cultural' code were reviewed, 
a sense of pride,/ joy and accomplishment were experienced, not so much a 
feeling that nurse educators did anything to influenoe it, as a sense of 
pleasure that the students havp it, regardlesa of origin. The issues of 
empathy, esthetics, ethics, body language, motor skills, self understanding, 
and transactions are all important to nursing, especially mental health nursing. 

The mapping on cultural determinants show some apread among all three 
determinants namely: associates, f amily-authority=, and individuality. This 
spread may be indicative of the relative- high influence of each, of these 
factors on these young adults at this period in their development. 

The ^rou^ is primarily "L" or "L with strong R" in the area of modal- 
ities of infereryco. ft look at the individual student's cognitive maps 



Note: The guide sheet will clarify the meaning of the symbol used, 
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showed soma variation but the significance of this cannot be relied upon for 
dbvious reasons, such as group size, membership, and methdcjology in general. 
The one black female student in the group differed in the area of cultural 
daterminants by mapping as an "r* and in modalitias of inference as "R", 

The male students in the group also showed some variability. One of the 
males scored a low T(hQ). indicating a low preference for spoken numbers i 
cultural determinants were "1" and **FS The second mala in the group had low 
;vCOtas on T(VQ) , i.e., less preference for written numbers, and T(VL), i,e,, 
understanding written words . The cult -ral determinant , of major impo:--:ance 
for him was "F". One of the registered nurse students in the group differed 
from the group in the area of modalities of inference, by scoring an "M" "D" 
indicative of a preference for categorical reasoning and reasoning based on 
contrasts arid comparison. 

A few statements about cognitive style and culture are needed at this 
point, IS there a relationship between cognitive style and culture? The 
answer is a risky one bu:. identification of some of the issues might aid in 
formulating an answer. The issues of socialization, acculturation, ethic 
group membership, socioeconomic status/ geographic location, and family 
structure must i)e considered. Caution must be exercised in generalizing 
about individuals from data on groups that are not homogeneous. There is 
much-g'rpup variability and overlap. Tha group is primarily "L" or "L with 
strong R" in the area of modalities of inference. This same finding was 
seen in the faculty group when individual learning maps were determined. 
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TEACHING STYLES . ' 

. Learning is only one part of the teaching and learning process. One def-- 
inition of teaching styles as discussed by Murphy and Brown (1970i529) is that 
it is the characteristic way of handling information and applying sanctions. 
Ah individual's teaching style is influenced by his conceptual system and, 
therefore^ teachers with different conceptual systems would utilize different 
teaching styles* These differences are not measures of teaching competence. 

The student and the teacher come to the interaction with differences and 
commonalities that must be reconciled if the educational benefits are to be 
' at a maximum. Teachers must be sensitiEed to the impact of their cognitive 
and teaching style upon the teaching^learning process, "That's a result of 
being at this school" was a comment made by a student upon hearing about the 
, mapping results in the area of modalities of infe'rence, .Perhaps the student 
was right on target with the explanation or are there some other explanations 
for this findings? 

Work by Coop and Sigel (1971) suggest that younger children are probably ^- 
more influenced by strong preference in style whereas college students have 
learned to adjust their styles to changing tasks. It is further hypothesized 
. that college students become more flexible and adaptive in their . cognitive 
operations in order to succeed in college. The students have 'discovered 
that they lAust accommodate their thought processes to different instructors' 

preferences and diverse teaching methodologies, i.e.^ they must learn to 

\. f 

"read" the instructor if they are to succeeu. They may have learned that 
it is more efficient to yield than to struggle (rather switch than fight) 
and therefore yield their particular cognitive . style preference to the in= 
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structional environment rather than attempting to assiinilate the different 
clasaroom variables into their ovm diverse style preference. It is important' 
to keep thia explanation in mind, inasmuch as the college student's cognitive 
style may not be as preferential as it is ndaptive. It may be delusive to 
aim for broadening a student's cognitive style preference for the student 
who has already learned an adaptive .skill. 

The ^similarity between students and faculty in the area of modalities- 
of inference brings us to the issue of matching students and faculty.' The 
results of the study by DiStefano (1970) indicated that teachers and students 
of similar cognitive styles describe each other more positively than mis- 
matched teachers and students. The work of DiStefano (1970) and James (1973) 
demonstrated that greater interpersonal attraction occurred with teachers 
and students of matched cognitive style. The interpersonal interaction and 
the positive evaluation occuring with matched teachers and students may 
facilitate the teaching-learning process wherein the teacher does better 
(instructionally) with students of similar cognitive style, and students, in 
turn, learn more from teachers with cognitive styles similar to their own. 

the work of Witkins and others (1977) leads to a precaution about match- 
irdsmatch effect and that is consideration of the issue of sex. In that 
particular study with adolescents, there was a positive response for the 
teacher of the same sex and the sex match-mismatch effect. ^ Other factors 
affecting the phenomenon of interpersonal attractions between matched persons 
are shared interests, shared personality characteristics, and similarity in 
modes of communication. \) 
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other questions to raise about matching for cognitive styie arei 

1* Does tnatching for cognitive s^yle make for bstter learning?- 

' 2. Doea the interpe'^sonal attraction between the teacher and 
student create a climate more conducive to learning? 

3. Is homogeneity or heterogeneity mora conducive to learning? 

4. Are the gains from matching worth the sacFifice^ made in 
diversity , of opinions and vie^oints? / . 

5. ^ Can the practical problems of arrangement be overcome? Is 

the outcome worth the investment? c 

6* How does match or mismatch in cognitive style work to produce, 
the observed effects? 

1 * What situational variables ^ such as bbk, curriculim design, or 
sequencing^ play a part in this phenomenon and what is that 
role or part? ' ^ 

■ 8, Does matching jeopardize the student by protecting him from / 
the realities of learning how to deal with a diverse ^ hetero- 
geneous world community? 

9* Is there enough known about cognitive style mapping that 

educational decisions with far=reaching implications can be 
made with confidence and 'a reasonable degree of scijndnass'7 

10, Should a student be excluded or exempted from learning in= 
formation which is inconsistent with cognitive style 
preference? 

11, Should the educational process aonsist of the easiest route? 

12, Is matching ethical? ' . ^ ^ 

IMPLICATIONS AND RECOMMENDATIONS 

1, Continue the seminars as a teaching strategy for mental ■ 
health content. Among the modifications made in the 
seminar class i^ere the provision of a list of possible 
topics and guidelines for discussing research and the 
inclusion of peer, self^ and teacher pattieipation in the 
evaluative process, * . 
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2"' Increase teacher and student sensitivity awareness , and 

"utilization of the concept by facilitating sharing of mfor- 
tnation on their respectivo styles. The teacher might share 
with the group at the beginning of the quarter what her 
approeich or teaching style is.. . » 

" . ' ' ' ' .• 4 

3 'Discover the "personality" df the group and adapt teaching 
strategies to facilitate learning. An observational checklist 

■ : could be helpful. 

4 *^ Stiinulate research' in the use 'of cognitive style mapping in . 

nursing eduGation and in 'nursing service. Do efforts m _ 
teaching ciients fail because minimal consideration is . 
given to. the learning styles of the client? , ■ 

5 Sensitize teachers to the implications of thoir teaching _ 
'"■styles for the teaching learning process, including evaluation. 

6. Condiict faculty 'development programs to enable teachers to 
'diversify their, teaching approach'as. 

7. Permit students to be '^elective of activities and materms;^ ^ 
which fit their style. - ^ ^ = = _ ,„ 

8 structure and require' certain learning activities which are 

valuible and support the "struggling" student in the processing 
of the materials. . - 

" ■' ' ■ ^ . • . 

9. Provide a multipliciey of instructional strategie.s f6r each 

learning objective. 



Id, 



Reinember that .cognitive style 'maBping is not the panacea or 
cure -for ail of our ills in nursing education! 
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A BRIEF GUIDE TO COGNinVE STYLE MAPPING 
Symbols and Their Meanings 

Two types of symbols, theoretical (e.g., words and numbers) and quali- 
tativfi, (e.g., coda data) are bas c to the acquisition of knowledge and 
meaning. Theoretical symbols differ from qualitative symbols in that the 
theoretical symbols present to the awareness of the individual something 
different from that which the symbols are. Words and numbers are examples 
of theoretical symbols. Qualitative symbols are those symbols which present 
and then represent to the awareness of the individual that which the symbol 
is. (Feelings, commitmenta and values are some examples of the meanings 
eonvf-'^ed by the qualitative syiriLols.) 

FOUR THEORETICAL SYMBOLS ^ 

1. T(AL) - TheoretiGal Auditory Linguistic.-- the sound of a word. 
2! T(AQ) - Theoretical Auditory Quantitive - the sound of a number, 

3. T(VL) - Theoretical Visual Linguistic - the written word, 

4. T(VQ) = Theoretical Visual Quantitative - a written number. 

The meaning of qualitative symbols is derived froin three sources 2 - 
Sensory stimuli, cultural codes (games), and prograimnatic effQCts of objects. 
There are 15 qualitative symbols. Five of them are associated with sensdry 
stimuli- 

1; Q (A) - auditory - the ability to perceive meaning through the sense 

of haaring; " 

2, Q(0) - olfactory - the ability to perceive meaning through the sense 

of smell; 
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3* Q(S) - savory - the ability to perceive meaning by the sense of 
taste I 

4* Q(T) -'tactile - the ability to perceive meaning by the sense of 
touch; 

5, Q(V) - visual - the ability to perceive meaning by the sense of 
^ sight I 

6* Q(P) - proprioceptive - sometimes referred to as the sixth sense - 

vehicle for conveying meanings associated with ''programmatic' effects" j 

7. Q(CEM) ^ Code-empathetic - the ability to identify v;ith, or have a. , 
vicarious experience of^ another person's feelings, ideas or 
volitions; - 

8. Q(CES) - code-esthpjtic - the ability of the individual under consid- 
©ration to view with enjoyment the "beauty'* and "pureness" of a 
resulting product, situation or ideai 

9. Q(CET) - coda^Qthic - a commitment to a set of values, a group of 
moral principlos, obligations , .and/or duties i 

10.^. Q{CH) - code^hiatr ionic staged behavior, or a delibc^rate exhibition 
of emotion or ttjmperament to produce some particular effect on other 
parsons ; 

' 31, Q(CK) " code^kinesics - the ability to communicate by means of non-- 
linguistic functions such as blushing and motions of the body, such 
as shrugs, sndles nnd gestures; 

12. Q(CKH) ^ code-kinesthetics - luc+^nr skill abilities; 

13. Q{CP) - code^prcxemicfi - the ability of an "individual to judge the 
acceptable "critical" physical and social distance between himself 
and others as perceived by the other person; 

14* Q(CS) - code--synnoetics^ personal knowledge of oneself in al] 
qualitative and theoretical symbolic, forms in relation to one's 
environment. 

15, Q(CT) code^ transactional - the ability to maintain a positive 

communicative interaction which significantly influences the goals 
of the perKons involved in that interaction. " 

CULTURAL DETERMINAWTS \ . . • 

The meanings thau man assigns to symbols ^hape and are shaped by his 
culture. The mair ultural influences^ or "cultural detertninants" of the ^ 
meanings of syrnbol^;, are famiJ.y, associates and individuals. 

F - Fam..iy I individual A - Associates 

MODALITIES OF INFERENCE 

The forins of inference the individual' uses in the process of deriving 
meaning: 

... ' ■ ; / 
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M - Magnitude inference process is a form of "categorical thinking," 

and utilizes norms Gategorically classified, and attitudes accepted 

as true by the individual as the basis for acceptance or rejection 

of advanced hypotheses* 
D - Difference deals with hypotheaes of difference, such as Qn6-to-one 

contrasts or comparisons .of selected characteristics or measurements. 
R - Relationship process considers a relationship between two or more 

characteristics of measurements* 
L - Appraisal type of inference considers, with equal weight, h/po theses 

of all the previous three (magnitude, difference and rexationship) 

in arriving at a probable conclusion. 



84 



Management of Teaching Strategies 
Kathleen J. M1kan 

INTRODUCTION ' 

Baing an educator in an institution of higher education today is differ-- . 
ent than it wao ten years or so ago. Social pressures for ./itability and 

cost containment/ coupled with the ever-growing increase in knowl. ^'}%t a 
more culturally diverse student body, and decreased federal fundinj d^^Tnand 
that we carefully examine all aspects of our higher iducational m^n'. for 
appropriateness, effectiveness and efficiency — in. -ding our day-to-day 
teaching strategies. 

An nurse educators in institutions of^ higher education^ we must learn 
not only to cope with the challenges facing higher educaticn in general, but 
we mus€ be prepared also to .andle the additional .social pressures specif lc£.lly 
related tu the preparation of a health care professional - Society Lb suill 
in need of health care workers and, consequently, individual?^ are continuing 
to pursue careers in the health sciences. Unlike so many other departments 
on campus, enrollments in schools of nurri:^'^ 'mve not declined. In fact, 
because other departments within the univejisity are experiencing declines: in 
enrollment and nursing is not, many schools of nursing are under pressm^e 
from their college or university administratqrs to increase enrollments to 
off-set the declining enrollments in other departments. 

^ } ' ■ . - 
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This means that nursing' faculty are being asked to teach mora and more 
BtudantB and to increase their student loads both in the classroom and in 
the clinical areas. Frequently, nurse educators Are asked to do this without 
any advice or assistance as to how to do it. Giving advice to other pciople 
about their teaching strategies has not been a comnion practice or an accapted 
norm in higher education, 

Hiatorioaily, the virtues of autonomy, academic freedom, and privf-cy 
have dominated the development of the profession of teaching. Tnese 
tradrtioma attributes of the teaching professiDn reinforce the idea that 
teachers are to be self-sufficient and self-reliant in handling their ciass- 
rooms or clinical tasks and responsibilities. What the teachers do in their 
classrooms or clinical areas is considered thexr business and is not uaually 
opfcn to discussion, challenge, or criticism. 

The practice of sharing problems and/or succeasful teaching strategies 
anong faculty colleagues is essentially non-existent. Except for, perhaps, 
■suudent teaching expariences, most teachers are expected to face their 
teatl-jng problems' alone . In fact, if a student teacher admits experiencing 
problemB, that person in often viewed negatively, i.e., a sign of being iti- 
adequate or a poor teacher. This type of conditioning in teacher training 
prcgrams results in teachers being fearful of eKpoaing their inadeqi-aoias 
and hesitant to ask colleagues for helj>. Teacher training of this kind 
stifles mutual sharing of problems, and solutions, and cooperative inquiry 
among colleagues regarding teaching activities. Thus, most teachers are left 
alone to sink or swim, haze or be hazed, In their day-to-day teaching , 
encounters. 
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The teaching methodo.logl ;)S used in higher education, and in nursing edu-- 
cation, havo remained basically the B&me over the years. The rapid growth 
and development of edunatioi^al teclmology in our society has had little 
impact on the manner in whlah teachers teach. Even though teachers have 
access to technology ^ they still primarily use the leGture^teKtbook method 
of instruction, :ct is easier to lecture than it is to be an effective 
Tnanager of in'struwtion and skillfully involve students in their own learning. 
Thvis, it ie not surprising that teachers tend to teach the way they were 
taught and their students do the same. 

Educators realize that there is no one correct way to teach. All persons 
involved ii) teaching are confronted with instructional problems on a daily 
basis. They manage to handle these problems in one way or another, but 
often do so withDut a clear understanding of the appropriateness, efficiency^ 
and effectiveness of their actions. Nurse educators in institutions of 
higher education eKperience similar problems and challenges as they go about 
l;heir teaching activities. Thus it seems appropriate to exchange ideas about 
.problems encountered and the teaching strategies that have bean successful, 

HAVE STRATEGY, WILL SHARE 

The follrwing strategy can be used effectively with large group 
instruction. The key to its success is that students are involved in their 
own learning. Why is involvement so important? Simply because learning 
requires involvement. Students do not learn because they hear the teacher 
say something, or see the teacher do something ^ rather, the students learn 
because they say something or they do somethiag, 
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The specific technique utilized to get involvement combines tht use of 
a variety of teaching materials and methods audiovisual material, p minted 
discussion questions, small discussion groups and group reporters. The 
specific content is presented by way of a synchronized slide=taie which is 
progranmed to, stop at two points to allow time for the groupB to discuss the 
questions listed on a handout. As the groups discuss the questions, the 
instructor circulates amon./ the groups to facilitate and enhance the small 

group disoussions. 

Each group is asked to select a reporter. Before the class ends, all 
reporters are asked to come to the front of the room and share their group's 
responses with the total class. Each reporter is responsible for initially 
sharing the group's responses to a different question (i.e., first reporter 
question one, second reporter question two and so forth) until all questions 
have been covered. All of the other reporters are encouraged to add their 
group's ootmnenta following the initial reporter's responses. In this way 
student involvement continues, and a variety of viewpoints and opinions can 
be shared with the total group in a short period of time. lmportan,t points 
that have been omitted or overlooked can be covered during the reporting 
session by the instructor, who serves as the moderator during the reports. 
The instructor can also use this time to encourage end provide opportunity 
for additional comments from the audience. 

The technique described here can be- effective with large groups. It 
need not be a long drawn-out affair. It is effective because the students 
are involved, they are active, and they give tne teacher valuable feedback on 
how well they grasped the information presented. Based on this feedback the 
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instructor can supplement, elaborate, or correct any misunderstandings th£it 



may have occurred. 

Three of the strategies discussed during the work session follow. These 
are presented because (1) the strategy had been used successfully and was 
described in sufficient detail that it could be reproduced, {2) the strategy 
described could be useful to a number of bther nurse educators in a variety 
of settings and across subject and/or clinical lines ^ and (3) the strategy 

was based on sound principles of teaching and learning, i*e^, student in-- 

■ f" 

volvement in their own learning. 

A stratBgy to involve students more in planning /c?r their own aliniaat 
eccperieno&B. 

Teaching Situajiqni 



Beginning nursing students are not prepared adequately for their 
clinical experiences and are anxious* 

Strategy % 

Students are instructed to write their own clinical objectives 
that ^ are congruent with the overall unit objectives. The students 
are expected to generate their clinical objectives based on the 
information they gain from their readings* These objectives are 
discussed with the student prior to their taking care of patients. 
During the discussion, the students are given assistanca in ref- 
lating their objectives to their indivudual client/patients* 

Degree of Success: 

The beginning nursing students are less anxious about their 
clinical experierjco because they have been involved in iden-- 
tifying what they are expected to learn in the clinical arei. * 



The students come to fee clinical situation better prepared and 
are able to relate thc% information in their reading to their 
individual patients - 

A strategy to meet speaifiQ needs of the registered nurse student* 

u'^eaching Situation ; ' % ' 
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The beginning clinical nursing course is not meeting the needs 
of registared nurse students. The curriculuin committee agreed 
to allow the m students to take a new and different nursing 
course and to allow the RN's to take it within a one^month 
inini^semester session* 

Strategy : _ 
Mini^semester workshop for RN students. 

Faculty utilised ideas from former and present RN students to 
design five one-week workshops on selected nursing topics. 

Of the five available workshops, the students can select four 
they want to at tend. The students are rotated througi. the 
workshops in small groups. Faculty members teach in pairs 
and conduct the same ^ workshop for four consecutive weeks. 
Multiple teaching methods, discussion , role playing, audio 
visual media and speakers are used. 

Degree of Success i 

The RN students recognize that learning through small group 
interaction is valuable and that they can assimilate much 
information and many ideas by this method. In the small 
groups, the students learn from each other as well as from 
faculty. Students report they get to know faculty better. 
The student like the" mini-semester because it is a change 
of pace from the regular semester courses; 

The faculty find Lhat the preparation for a one 12-hour 
workshop (two 6-hour days) is manageable and a welcomed 
change of pace from other types of school activities. 

i 

4 teaahing Btrategy to help beginning nuTQing students improvB note 
taking during l&atums. 

Teachin<^ Situation : ^ 

Beginning nursing students have difficulty taking orga- 
nized, pertinent notes during lectures at the college 
level. The class is taught by two instructors. 

I 

Teaching Strategy i 

Team teaching with oiie instructor presenting the infor- 
mation as the other instructor "takes notes" on the 
blackboard. 
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Degree of Success i 

The students find the technique very helpful in helping 
them identify important content. It improves their 

performance on exaininations , Having another person - 
take notes on the blackboard saves time for the faculty 
member \sao is lecturing. Thus, the lecturer is able 
to cover more material within the available class time. 

The use of this technique routinely or over long periods 
should be discouraged as the teGhnique tends to increase 
student dependence on the inBtructor which results in 
much discomfort and anxiety when the second instructor 
is not available or is not performing the note-taking 
role. 

Other successful teaching strategies reported by the conference partici- 
pants related to the use of commercially or. locally produced learning materials; 
the establistaent and development of autotutorial laboratories r the use of 
learning modules and learning stations (learning areas that are set up to 
accomodate small groups of students who rotate through and perform the skills 
stated on cards) . • ' 

Role playing, both formal and informal, was frequently mentioned as an 
effective teaching strategy. The formal role-playing s.;rategies involve the 
preparation of written materials ahead of time. The materials describe the 
roles to be played as well as information about how the role playing is to be 
conducted. The informal role playing teaching strategy requires little or no 
preparation, by either the instructor or student and is most frequently employed, 
by asking students to^ role play actual situations they have encountered. . , 

Variatioris in' the use of learning objectives are being tried in several 
schools* One person reported the use of clinical objectives that are pro- 
gressive in nature and correlate ^^ith the letter grades of *'A^ B," and 

*'C*" All students are required to perform ^all the behaviors at the "C" 
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level to pass the course. To receive an '"A" a studr-nt must demonstrate 
proficiency of the behaviors at levels "A," "B," and "C." Students are 
responsible for identifying which of their own behaviors met the course 
objectives. The students use anecdotal notes or faculty observations to 
document their iDerformance of the objectives. The objectives are weighed 
and a final score at the end of the semester is based on those objectives for 
whicli student behaviors have been documented or observed. 

The use of a "test" as a teaching device was reported to be an affective 
teaching strategy by one participant. In- this case, the test is given at 
the beginning of the class over the content to be presented during the class. 
The. instructor, then uses the "test" for organizing and presenting the class 
lecture. Used in this manner, the test serves as a mechanism for gtimulating 
class discassionv for .Aaintaining student interest, and for providing student 
feedback* 

Neither time nor space permits the description of all the successful 
teaching strategies presented in the small groups. However, the cases 
described above may provide some ideas for new teaching strategies that can 
be used or adapted. 

The author wishes to express appreciation to Patricia Crumpler of 
western Piedmont Cormminity College, Kathy Hendersc^u of the University of 
Maryland, and Ann Richards of Texas ChrioUian University for sharing the 
teaching strategies described in this article- 
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' CULTURAL AWARENESS . 
Norma RawUngs and Ann Morgan 

From the newspaper hastily read at breakfast to the television comedy 
viewed in the evening, we are confronted with evidence that we live in a 
pluralistic society. Many culturally distinct groups can be identifier 
ea^h with learned and shared value systems and patterns of benaviors, language 
and thought. Safe and effective nursing care for individuals in this cultur- 
ally diverse society must begin with the architects of the educational plan, 
the faculty, and behavior within the context of a culturally diverse society. 
We believe that the nurse educator interfaces with 'thi - society as an in-- 
dividual who is a product of a culture and a component of a system. 

The nurse is a product of a culture. EKDerience has taught most teachers 
to be cautious in expressing criticiSin of other cultures. In fact, the 
enlightened teachers are quite liberal in stated beliefs, and may 'supress the 
awareness that they are individuals who live within the beliefs and behaviors 
of their culture. The values of, the dominant mainstream culture, such as 
success, respf,^ctability , good manners, and cleanliness, are readily absorbed 
by the teacher who, in subscribing to. them, may repress differences found in 
self. Landes (1976) in reconstructing the family culture of teachers found 
great variability in their origins, despite their expressed professional 
oneness and middle class appearancG. She states that within each teachyr 



there are hidden points of reference which interact with those of other 
ancestries* We believe that in- a program of faculty developinent there must 
be experiences which make nurse educators aware of tnese points of reference 
and the culturally sensitive aspects in their own lives. Landes ^states "one 
cannot validate on cny deep level that which one does not wish to perceive 
in thyself." ■ 

Cultural groups vary inn If icantly in the defijiition of health and 
patterns of help seeking, preferred healc'rs and therapies , ^content that is 
valued, prefc^Tred coiwnunication channels and language, sanctioned tescher and 
learner b^^jhaviorr tnethods of discipline, and self ^concepts which are rein- 
forced. We believe that a coinprehensive program for faculty development must 
give educators and students an opportunity to eKplore- in depth these areas , 
which have potential for creative growth or conflict in tha educational setting* 

Ethnocentrism, the tendency to judge other groups by the standards and 
practices of one's own culture , leads one to believe that one's own pattern 
is correct, anS that others represent deviation from the norm. Cro^ s-cultural 
errors in c?bservition and interpretation can be anticipated, and sensitivity 
regarding them can be .a^qui *^ed. Spin ler (1974) presented a sensitization 
technique used v^ith the f tanford undergraduate students at one of the uni- 
versity' s overseas centers. Spindler showed ten 35Timi color slides, and 
asked students to record their responses to these slides. Using simple 
inductive content analysis, "^he identified" several common problems in cross- 
cultural 'perception. He found misinterpretation (1) when there was no 
counterpart in the culture of the viewer, (2) when the situation, viewed^^ was 
^ambiguous, (3) v;hen the viewer stereotyped the situation, within his own' 
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culture, (4) when the viewer h^^^ stereotypes of another culture, (5) when 
motivations and feelings were projected on the situation, and (5) 'when there 
was a limifed sampling of beha^io^* believe that by exploring these areas 

for potential misinterpretation within a school, faculty may increase the 
ability to correctly perceive student behavior cross'-culturally * 

The teacher is a component an educational system that represents the 
values of the dominant culture - The faculty mender is in a position to 
symbolize conmiunity standarde v?hich may or may not reflect the needs of all 
members of that community. believe that the teacher must become sensitive^ 

to the incongruity between car^^i^ institutional standards and the needs of 
individual students* 

To many students the educational setting provides evidence of an encom^ 
passing culture in an experien^^^^i^h can be intensely depersonalizing. 
The spatial and temporal dimensions of the school culture which have been 
absorbed by the teacher may be alienating to the student. We believe that a 
program of faculty development ,JWIt....p^!QMida..o^ and 
faculty to identify those aspects of the school culture which support or 
conflict with the students' expression of authenticity and autonomy. 

To provide a program £o^ faculty development which wQuld.be responsive 

to the needs and successful affecting change, members of the task force 

at the University of Maryland School of Nursing developed the following four 

goals^ and devised methods of jfleeting these goals. . The task force proposed to 

1, Identify presently gristing teaching-learning barriers in 

order to diagnosi problems e^erienced by students. 



2. " -Create an anvironment whereby faculty can become more aware 

•^r their values and attitudes toward culturally diverse 
students, i.e,, individuals who speak English as a second 
language, are socialized in a rural environment, black, 
' male, or oyer ^ thirty-- five years of age, 

3, Make available a variety of approaches/strategies that will 
assist faculty in their adaptation to cultural differences 

ing students . 



4, Identify cultural and ethnic influences that may have impact 

on learning,. . 

In an attempt to facilitate achievement of our goals, four videotaped^ 
vignettes were developed to increaae faGulty'a ability to identify positive 
and negative cultural' and ethnic behaviors that nmy affect learning; identify - 

■ ' i _ 

teaching-learning strategies which may inhibit or enhance learning; discuss 
interpretation of behaviors exhibited by culturally diverse students. 

All videotapea, with the exception of one, were developed utilizing 
culturally diverse students' descriptions of previously experienced inter- 

■ /; ■ ■ , 

actions with selected faculty. The one exception is an unrehearsed interview ; 
with a graduate nursing student from India. Bach videotape was presented 

// r " . , ' ■ 

and analyzed by; conference participants. Some of the comments and observations 
of the participants follow. 

Videotape Rehka, a graduate nursing student from India, describes 

her experiences, 

Comments/Observations i 
Native dress* 

Adjustment to a different environment (weather, time, city). 
Grief for native land. . . ^ , 

Guilt feeling in seeking help from others. 



Language barriers — repetitl'on to be understood and 
difficulty with pronunciationjSF "friends' making fun of 
me helped improve .coiranunicctions with others*" 



Role of women culturally d 
person who gives birth to man 



iff ©rent.. "Woman is creative 
who makes the decisions." 



Male^Female problems — could not go to male academic 
advisor for assistance due to cultural differences with 
role expectations. J 



Videotape Ili Larry, a male student assigned to OB^ encpunters 
discrimination, / 

Coimnents/Obserya t ions i 

Overlboked as a nurse and /bale student* 

Men's rest room excluded in orientation^ 

Asked to leave the room for female perineal prep* 

what is the difference between a doctor and a male nurse 
being in the labor room for prep? 

Is it the male r urge's role vs the female nurse's role 
to lift a patient from' the stretcher? 

SocialiEation of the male student nurse limitations of 
nurse faculty expectations. 

Identity crisis male vs nurse. ^ 



Videotape III: Joanne ^ a black student, /has a conference .with a white 
instructor regarding an assignment* 



Comments/Observations % 

Several degrading expectations from teacher "Did student 
write the paper herself?" 

"Teacher going to" check resources particularly to make 
sure direct quotes are quoted," 

Don't often see a paper that good (from black students)* 
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, "DO you know Elizabath Davis?" — assume all black 

. peopie know each othsr and are alike. 

Articulate black person — assume it is unusual" for a 
black pBrson to be articulate. 

Double- message at end ^- "Doing a "good job" ond offers 
help to Btudant after above eoniinentB. 

Note student's res^onso at and of "Yea M'ani." signify 
cance of this in iriVeraction? 

Any changes in student's communiGation pattern from 
beginning of interaction to end of interaction? 

Affect of interaction on student's self concept, 

'=*.•- . 

Videotape IV: Sally, an older student,' meets with a younger instruotor 
before making 'a home visit. 

nts/Observations i 



Life experiences not utilized or taken into consideration 
at 



Relate better to faGulty as a peer^ than to fellow 
students — caught in between; the two groups, 

.Faculty especially if younger, apt to be threatened 
the student. 

Instructor ignoring or hot /illing to take into account 
the student's own experiences with child.^en. 

Teacher's focus is on theo^ty and student's focus on 
experience. 

Did teacher resent student wanting to know about 
teacher's chil=d? 

Is teacher facilitating/ student ' s learning? 

Is there any practicality to student's response of *'if 

it works, it works," as opposed to a theoretical response? 

How is theory derived? 
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- Can student use her own experiences to halp provide 
a theoretical frainework for nursing intervention? 

Is there a double threat situation between student 
■ and teacher? 

Education can be instrumental in the understanding and tolerance of 

/ . " ^ - • 

different systems of belief and values. As De Tornyay and Russell (1978) 
asserts 

The concept of a pluralistic society was soarcely thought of ^ 
least of a] 1 discussed, in spite of the fact that the United 
States is made up of many ethnic groups. Those few ethnic stu- 
dents of color who were in our programs were socialiEed into the ^ 
culture of the majority — the Anglos-American culture — and 
' expected to conform to majority values and norms. Only recently 
have new life and fresh approaches to the profession been devel- 
oped, thanks to the incorporation of ethnicity into the nursing, 
ranks and into the curricula of schools of nursing, Pocusing on 
culturally diverse grpupe has markedly enriched nursing education, 
and affirmative action has helped make nursing a less hbmogeneous 
profession, more reflective of the diversity of American Life. , 

During the Special Interest Group session participants emphasised the 
negative bahaviors evident in the videotapes and discussed strategies for 
change utilizing cultural awareness and understanding. ' 

' The ^ group leaders introduced a values clarification exercise. Partic- 
ipants identified "Twenty Things I Love to Do," the cost of each activity ^ 
■ the person with whom 1 like to do the activity, and the last time each- 
activity was done. The responses were shared to demonstrate conflict of 
varues as well as integration of values. This was an attempt to facilitate 
the process, of value clarification as it relates to cultural awareness. 
Cultural differences and cultural biases were shared by group members. 
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Identifying Learning Obstacles 
Gall Kettlewell 

'we know a great deal about Gulturally diverse students-^who they are^ 
what they aspire to, and what problems they have. We try our best to use 
learning strategies which bring sUGcess; to our students. Yet? how often 
have we said at the end of a quarter or a .semester, "If I had only tried 
harder, so=and-so might have passed." That "trying harder" is very nebulous. 
That "trying harder" can be translated into so mary questions we have about 
how students learn and i ly tiiey do not learn It is just sueh questions 
that have provided the emphasis of, the Faculty Deveiopment in Nursing Education 
Project at Tidewater Community College, Fredrick Campus, We are trying to 
identify the problems of culturally d . . arse students early and then work to 
eliminate or at least help the students overcome them, 

Ouf; efforts include a combination of counseling, and developmental 
studies. T scicince and technologies counselor^ keeps a statistical record 
of students who are failing in nursing, determines the problems, and works 
with thg nursing faculty and reading consultant to remedy the situation* All 
applicants to the college take the Comparative Guidance and Placement Test* 
Students interested in nursing also take the Nelson-Denny Reading Test, 
They need to scoij on the eleventh grade level or equivalent on both tests. 
If either of these shows a deficiency, then the student is counseled into the 
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appropriate developmental courses which are developmental reading, science, 

and math. After students satisfactorily complete the developmental courses, 
they are admitted to nurBing. The counselor works out a weekly schedule 
with each student trying to show them realistically what they can expect in 
terms of required hours for study, class, and other responsibilities. There 
is a continuous dialogue between the nursing faculty and the counselor. The 
students are aware of this and approoiate the added attention and, dedication 
df the staff. 

A second factor in improved status of culturally diverse students on 
our campuB is in the area of feading. Nursing students may be requested to 
take developmental English/reading. Once they have completed these courses, 
they may enroll for advanced reading classes which will enable them to gain 
fluency, acquire further vocabulary growth, and improve their study skills. 
The two -advarced reading courses are scheduled each quarter for the general 
student body In addition, a reading in science course was offered in the 
summer of 1978. ?re=nursing students who were reading below the tenth grade 
level received letters from the counselor , suggesting that they enroll for 
this course. Ten of fifteen students enrolled and studied reading in science, 
vocabulary in science, and study skills while they ware also taking develop- 
mental health science. It must be pointed out here that not all students 
scored eleventh grade level on the timed, standardized Nelson-Denny at the 
end of the quarter, but they were completing eleventh grade reading course 
work in science with 85 percent^ comprehension as minimum acceptable score. 

It is important to understand that skills and mastery effectively used 
on a timed test will not come simultaneously.- Once the skill is learned, it 



takes time to reach fluency, especially with a culturally diverse student. 
It might also be noted here that test=taking skills should and can be taught 
d^uring such a course* , 

Another service provided by the developmental studies English staff is 
a study of the current nursing textbooks. Seventeen texts have been exaflfiined 
for readability level and study helps* The result of this is a chart showing 
these factors* From this study the fundamentals of nursing course text has 
been changed (from Fuerst to DuGas) * The. nursing faculty sees this success 
as, changing hopes for success of students^ who have of ten expected failure. 

Faculty members have learned the SQ3R study technique procedure so that 
they can use it with each textbook to show their students how to get the most 
of the textbook- They have all learned ^to do their own readabilities on 
textbooks so that^ as new books come in for adoption ^ they can examine content 
and suitability for reading and study. Another quick check on suitability 
for texts can be done in the classroom during the first week of classes* It 
will show whether , the text is on a student's instructional or independent 
reading lever^ arid will indicate success with the text. This instrument is 
called a Cloze Procedure Test* , These three items will be explained in detail 
later, = . 

The impact and implication of our efforts have been great, According 
to statistics, kept by the counsleor, the percentage of developmental students 
remaining and completing the prograin has completely reversed/ for the good* 
Of 59 students who started the program in September only three are in real 
difficulty compared to half of the class in previous years* We have observed 
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that all members of th. class ar. attending tutorials. Our stuaents scored 
second in the state of Virginia on the licensing eKamination this year! 

TYPES OF LEARNING 

The two types of learning we are concerned with in our program are in ^ 
the cognitive anft.aff active domains. The cognitive area will be described 
first because we think of teaching in terms of learning '^he material and g 
successfully passing the tests and courses, 

Cognitivj^ „ 

Bloom's hierarchy in ascending order isi 

^ f . Evaluation/Synthesis 

Application/Analysis . . ^ 
* " ' Comprehension 

Knowledge * ' ^ 

■ The knowledge level comes first. Questions In what year did Columbus 

discover America? faiowleagei 1492. This is the kind of question asked on 

a short answer, objective test. This level is essential before the student 

can progress to the other levels beyond this. If students cannot achieve at 

this'level, their comprehension skills are elementary. They cannot analyze, 

apply, evaluate, or synthesize the information on the page. 

Three levels of cqmprahension , in descending order, arei 

Literal , what the author said 

' interpretative what the author meant by what he said 

Applied knowledge of the, content in relation to 

experience resulting in new ideas ■ 

The student who has not learned to go beyond the knowledge or literal 

■ level must be taught to do so. How can Mary Lou do her clinical training al 
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the applied or evaluation/synthesis level if she only understands what the 

author said? , ' 

Some of the specific cognitive skills a student must possess to be 

successful in the science reading materials used this summer for the prp- 

nursing students arei 

Find Statement and Support Pattorns . Directions? Refer tp the 
paragraphs of the selection as indicated below, Fipd the state-- 
ment (niain idea) and supporting information (details) and write 
them in the spaces provided* Keep in mind that you are likely 
to find information that doei not support the statement. 

Must your students be able to determine main ideas and details? Do you 

assume that they have mastered this skill? 

Practice Noting Sequences . Directions: Read the paragraph 
below. Then list the steps in the process of the development 
of the frog, ^Teli what takes place at each step. 

Is sequence important in the care of. the patient in the recovery room? 

Recognize Cause and Effect . Directions Read the statements 
below to f4nd cause and effect relationships- Then list the 
causes and their effects in the spaces provided. 

Cause I Effects 1 

Must a student know how to determine the difference between cause and 

effect of a neurological problem? 

Read and Experiment , Directions i Read the following experiment,^ 
Then set up the experiment in the space below* 

Object i Apparatus 
Procedure I Observations: 
Conclusions: 

Is this more than reading at the knowledge level? 

Make Charts . Directions i Read the paragraphs below about gems* Then 
make a chart of the information given. 

Gem! ' ■ Where Found How Formed 
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Classify . Directions i Classify the information in tho following 
paragraph under the three headings given below. 

Areas of Scientific Studies Name of Course 

information ■ . Related to Area 



ouiLuuarize . Directions! Reread the section headed some diseases 
are caused by germs. As you read, TAKE NOTES on the most im- 
portant facts or ideas, and write them in the space provided. 
Then, rewrite the notes into a sumnary paragraph. 



Notes 



Summary 



Make Comparison . Directions i Read the following paragraphs 

about steam engines. Then make comparisons in the spaces provided. 

Compare the two types of boilers. 

Differences , . Similarities 

ft ■ i 

This is by no means an eKhaustive list of reading skills a college ,^ , 
'student should have mastered to begin the nursing program. It is, howaver,^ 
reprasantativa of the complexity of reading and thinking/organization/structure 
which students must be able to handle for success. And this is only in the- 
realm' of comprehension. Just as important are vocabulary and study skills, 
A student must be able to unlock words or see familiar forms in new words. 
Textbooks which list important prefixes roots , and suffixes from La^n and 
Greek aid students who already have language barriers. 

Common itudy skilla^for college students include the^ ability to use^l^e^ 
textbook efficiently, take notes, write svunmaries, use the dictionary, and 
know how to take tests. Students who have never needed these skills n4ed 
your help. They use the dictionary faithfully to look up the meaning of a . 
word. HOW much more must they know before they understand what hemoglobin %b7 

Most culturally diverse students on our campus go through at least one , 
developmental English course before they begin the nursing program. BUT, 
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ftba.ia no car: — ^ry^over from the developmental class to the nursing class, 

liMWiiits still have difficulty. One problem instructors face is that 

honkeady kn^w and use these skills*. Thay seldom analyze what skills are ^ 

taiitinthe ^^^^^ignment and do not point out possible blocks to learning 

tha gti^^fir^ ^ reaches them. Another problem is that a student who has . 

about thes - - ^ skills and ted Cliques cannot have mastered them in ten 

nKaive weeks- The student is now AWARE of the larger realm of comprehension 

H^tesonia exper — ^ience* Continued awareness from the science or nursing 

nstruotoi: can hiL jp a student to grow. . ■ . 

Mfoctivg 

Copitive slcL 11^ were discussed first because learning the material has 

Si our prime in f- — ^r-P^t- - However ^ students can only learn the skills and ■ ^ ' 

kmrm nigt-fri a H if they have the attitude and motivation to do sp. 

fefore, it is L^_..^mportant^ that we consider the affective domain* Krathwohl's 

mm^ \^ i^mmfxi i in discussing the affective domain* This'^^ taxonomy » in 

sCfiiiWng order / t~ ollows i , ' " ^ ' 

• ? Commitment ■ 

I . = ^ Valuing 

^ . ", : Receiving^ o . 

^ At^tending , ; . ; ^ 

) H^iry hom% ciefinition of th^se isi A, student ^who attends coines to 

liB for fifty nii___xiutes, A student who receives ^ listens to, the lecture but 

l^Hheapons^s^ A student who values , responds to what was received and 

^tej%ents ^^r i n t i t " A student who is committed decides to participate 

titts, make, a pa^^^o on the test^ come to class on time, and read the 

s^lgients daily* . ^ - ^ ' ^ . . \- ' . 



We know, of course, that without commitment little learning can take 
•place, at^ the knowledge or any other level. Considering the characteristics 
w.e have detennined as fitting culturally diverse students, our first task is 
at the .peraonhood Jleval. A student who has problems of motivation, goal- ^ 
orientation, failure, or acceptance must be considered in terms of commitiner|t 
to the program before wa tackle intellectual growth. In .fact, one of the \ 
greatest learning obstacles students have is attitude of faculty toward thein.. 
What affective behaviors do we expect of ourselves in aiding the student's 
growth, change, and independence as a learner and as a nurse? 

in a list of skills needed by faculty for, working with "high-risk" or 
'!new" students are two human relations skills. Faculty must understand that 
the student KNOWS how he is being treated. The instructor must also under- 
stand how hg is treating the student. ^ Before writing affective behaviors 
for students educators ought to 'write them fbr themselves. ^ 

HOW do we identify a student's affective obstacles to learning? First, 
counseling will pick up some idea of a student's self-concept in interviews 
before the program begins. Some schools administer a self-concept test by " 
using the Rotter Self -Concept Scale or the Nowicki-Strlckland Internal- 
External Test. .HOW the student sees himself and Ms attitudes toward school 
'[ and learning oan^help us in advasement, and instruction. Another type of • 
indicator of student attitude can be self-made. This is in the form of an 
■ incomplete sentence test. Such a measure is easy ■to construct and administer 
It quickly gives the instructor a look at the student's hidden agenda (the 
emotional, attitudinal baggage he carries with him everyday) which may, have 
nothing to do with what you want him to learn that day., It Tmay^ however, 
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have eyerything to do with whetH^^ he passes or fails, sample of the 



inGompl6te Sentence Test f ol-lo^p i 

1. My favor it a subject in cdlisp is ' ^ . ^ 

2. I Bometimas am afraid==,of 

3* - I never want to . . 

4, Moat of my instructors are .. . 

5, Going to college is . . 
6* I. hope that I can 

7. I think that my life ig = , ^ . , 

8. I like it when my husband/f 3ther ' 

9p My favorita person is j " 

.10*' I get .kind of depressed \ihm^ ^ ' 

11, i Doing hoinawork is . 

12. I think that my brother/sifter is 

13* Most of all I would like ^ / 

14p My home is usually ^ ^ , _ = 

15^ 1 get angry whan , 

16, " 1 ain unhappy when 

17, 1 hope that my future is 

18, Grandparents are / 

19, My family thinks that i j 

20, I wonder if | 

21, My family/ spouse feels that grades are 

22, I like to read books abo^jt ' ' 
23/ I think that- college ia 

24. 1 think reliding the nawspap^s^ ./ . 

_25,^ I hope that will never hs^s to ' ^ 

26, I aometimas ge^. nervous . whe^^ . ^ ^ ' 

27, The easiest thing atout college is ^ ' ' ^ 

28, I am happy wheri . 

29, 1 don' t "like it, when my faitiiWspouae 

30, ^ Studying^in college is . I ' ■ 

31, I like it when my' wife/rnoth^^ 

32, ' 1 would rMlly like to 

33, When I get out^ of college. I hope tp 

34^ I sometimes worry about ■ . \ j 

35 i I think that'^ reading science booka is ^ 

36, ' If I could be anything In -t^^^^^^^ wouJ.d wa^nt ,to be 

37^. I think ^he future will ; . ■ " 

.38, Reading social studies bQQ^s .is * . ^ ■ ., ' , 

39. My family thinks that readi^^i is 

40* ^ Reading math word problei^s is j ' ' : 

41, In an English course, X usually , like to read about 

42, '^This college is . ^ ,3 

Noter The test is a revision of a secondary level test by Wilma Miller, 
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IMPLICATIONS FOR NURSE EDUpRTORS, \ . 

Cognitive and a£feati|ve materials discussed in the preceding paragraphs 
are as important for nurs4 educators to understand and use as they are for 
developmental faculty. . ^he remainder of this presentation describes what ■ 
nurse educators can do in their classes to help students as they continue 
to ovarGome learning obatacles* . 

The fry Readability Scale 
' First, it is important to know how to determine the readability of a 
taKtbook. using the Fry Readability Scale the following ateps can be 
perforTneds ■ 

1. Randomly select three sample passages and count out exactly 
: 100 words beginning with the ' first word of the sentence. 

/ ■ Count proper nouns, initializations i and nmerals* 

\ . : ^ ^ ^ < ^ -P 

' 2. count the riun^er of sentefices in, each 100 words, estimating 
^ ' length of r i fraction ^f" the last sentence to, tHe nearest 
1/lOth. , ^ _ . " 

^ 3, Count the total number of Eyllables iri^ Saoh IDO-word passage. 
^' Add that nurt^er to^thq 100 words to give syllable count. 

(Example^ 100 words. + 50 syllables * 160) 

' ' 4. Use the scale to determine grade level. 

' / Syllables ^ \ ^ S entenges ^ 

167 ^ 
' 172 . 



4.5 
5.1 
4.8 



Total ' / 

Averages 163, (use 1B4) 
Grade Level i 12 



Total 

Average 4.8 
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- EXAMPLE of eyllable count' Oopper is esaentiaL to hemoglobih Eynthesis* 
, \;. . :/ ' ^6 words + 8 other, syllablai .^ 14 syllables : 



The chart on the. preceding pa^e depicts the readability level of selected 
nursing -teKtbooks* ^ ' ■ 



The Cloze Procedurj Test ■ . , 

Another test ^ the CIoes Procedure Test,* can ba used to determine the 
suitability of a text for entire class or individuals* = 

Method I A, Select a 25.0 word passage at beginning of. text^ok. . 
B, VTypi .the passage omitting.^ exactly.. every. 5th word. 



C. Hand out copies to each member of groug and have "student ' \ ^ 
read complati passage ^ silently* Then ^bava him coinpleta ; ' j 

-every blank Mth best word' he can* - . . ' ;^ 



Scoring: A; Count up number of blanks containing 'exact 



words i 

^ / 



^B. Divide the number of words exactly replaced by /the total' 

(45-50 percent correct shows book, is on student 'i INSTRUCTIONhli , 
•level. ' 60 or more is on INDEPENDENT reading /level. )^.. 

* ' C, Mill tiply aboveL score By 1., 67 to" determine':^ 
grade lavel, , , , 

„ Note: ..,if gl-ading includes use of context clues, then synonyms may 
/be accegtetf" as Gorrect answers, e,g,-, doctorf physician. - 

Deterniine, the suitability of a text for nursing using the following 



information: / ' \ ' , , ■ 

' ■ "' . The Patient and'^tha Nurse 

"The patient is a person" and ■"PAtignts are people'' are phr'asea used 
ERJC ^ frequently in the nurse '5 education; These or siTt-ilar phrases it; . / • to 
\ remind the nurse 2 the patidht, whoever "he / be) is a human 4 _ 



/ . ' ' • 

with ^opes and desires # 5_ 

patient may be 7 

elde^rly person. 10 



and dislikes^ strengths and 6^ 



man or a woman / 8 



boy or a girl, a 9^ 



he is and his 11 



paramount impdrtance to him 13 
corisideration in his 15 



are important J They 
they should be a 14 , / important 



Tha 

or an 
are 12 



/ 



Being a patient placeB 1^ 
of places 18 
20 ~^ 



The . number 



patient care is offered 19 



person in a unique . 17 / 

are numerous and differ 



"one who 
Patients 25 



The person who becomes 21_ 
is under 23 



patient is often described ^ 



care of a physician 24 



in a hospital. 



receive care in the 26. 



office, in the outpatient 27^ 



of a hospital^ in 28/ 
and 30 
32 



^ recently in offices of 31 

where care is given> 
Perhaps fo^' 35 



own homes> in nursing 29^ 
es 
33 



/in other institutions, 

in private practice. Regardless 



experience has special meaning 34 



the patient 
greatest significance 
family/ friends 39 



people, institutional care has 36^ 



The. fact 37 



the person is^ a^>/ay 38 



usual way of life, 40^ 



and is faced with/ 42 / of disease or illness 43 

may tax^ 44 resources in understandings and 45 



_ his home, 
for only a short 41 , 
_/ unpleasant eKperiences 
adaptation, ' / 



/ 



The individual who becomes 46 



patient in a' hospital 47 



on a 



different status 48 • / is surrounded by circumstances 49 unlike his 



usual 




50 



'I'tal environment becomes different from the fahiliar. 



/ - \ - I 

The SQ3R Study Technique 



The ^Q3R 'Study ^Technique^ can help students^use textbooks more 
effectively.. The f^ve steps/of SQ3R arei 
1, S - Survey 

' " / 

Read the /title of the chapter. ^-1 
i Read' the introductorv statement* / ' 
/, Read^all main headings in order* / 

I' ■ Study illustrations and read the cohcluding statement or suimnary. 
Try to recall the outline of the chapter before going dhy 



/ 



/ 



/ 



*This discussion was oxqerpted from Re ad i^ng Strategies jo:^ je c oridary School 
Teachers (Burmeister,. Lou E.) pp/ 84,85, A ■ : ^ 



113 



- Question 



/ 



Look at the first main heading. v ; 

Ask yourself what it means. . -u 

Ask yourself /questions that you think might be answered^ in the • 

section, ter example, if the heading is '^Pormal English," ask 

yourself questions, such asi What is formal English? Do I 
aver use lormal English? When should I use it? What other 
levels ofi English are there? / 



Read to find the answers to your questions. / 
If the artbwers are not there, you may wish to find them somewhere 
else. ™ese are good quristions to ask in class or ta go to Che 
library ko find the answer. 



:^ - Recite 



RecitJthe answar to yourscDlf to help you rCTiei^ar it. 
Ask ydurself if the mnswfi*rs given by the author make sense. 
Ask yourself if you have a new idea which you can use--perhaps in 
a Written assignment or in conversation or in performing a task. 



^2 ^ Review (or Reconstruct) 

pe/iew the whole chapter in a "survey" fashion, but with the detail 
/filled in. Then reconstruct tthe outline in your mind or on a 

/ pieco of paper, - = ' 

fry to recall important ideas' the author has discussed. 
Uk ■yourself some interpretive level or critical-creative-evaluativ 
level questions'. ■ , - n_ 
'Try to think o^f applications of the ideaB^ learned. 

summary, it ' is important that all eduoators are'' familiar with' the , 
.f ■laarning and /thoio measures- that can be ' used to minimize obstacles 
:.rnlng. ' it is imperative that parsons in' developmental studies and 
disciplines collaborate in their efforts to maximize -learning ' , 
rtunitie's . . ... - 
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; " . ROSTER OF ATTENDEES 

RepreEentatives FrQm Institutions 



ALABAMA ■ , . . 

John' C, Calhoun. College 
Rhonda L, Kirkpatrick 

Lawson State .Conmiunity College 
Charlie T* Williams 

S. D. Bishop College 
Shirley, Holt 

Univarsity of Alabama in 
Birmingham 

Janet Awtrey* , 

Kathfaen B, Go Idblatt* 

Kathlaen> J. Mikan* 

Delols H. Skipwith* 



ARKANSAS: ^ . 

Southern Arkansas University ^ 

Wendy EV Bonner " * • 

Marie Brown 

Billie^ R* Cameron 

Vonda J, Dees 
" ,Gail Gilbert 

' Pat Williams ' , ' 

"University of Arkansas at , 
Fayetteville 

James 0* Hammons 

University of Arkansafe at Pine 
^ Bluff ^ ' 

Ruth Brown ^ 



* Program Pa;gticigant / ' 



FLORIDA 

, Bethune^Cookman College 
Barbara Engraih 

Daytona Beach Comnunity College 
Nancy Henderson^ 
Jane SGhell \ ' . 

Sharon White , 
Elizabeth Wilson 



Polk Coipiunity College 
Joyce Berratto 




Albetta Dodd ^ V 

, Naydene Fields; . 
Jessie Robinson 

Santa Fe Coiranunity College 
Carol Desautels 
Vivian Filer 

Larmy Teague ' . 

Verdell Washington 

Valencia Community College 
Ann M. Carigan 
' Annie Bell Johnson 
Glpria Pickar * 
Ruth Webb 

' University of. Florida at 
Gainesville 

Sue Legg* * 

University of North Florida 
Katherina Webster 



116 

J 



GEORGIA 



Albany State College - ' 
Louise Byrd 
Peggy J* Cutler 
Miriam L,^ Johnson 
MaE^aret Lewis 
Brenda Tiller 

. DaKalb Collage 

Barbara Langford 
Barbara Laa 
Mary 0' Brian . 
Edith Scott 
John J, "Stathas 
Tamra Yon.g 
Susan 'C* Zumpf 

Emory University 

Sylvia Fields 
\ LaRatta Garland . 
\ Judy Mabc 

. Georgia College 
Mary M, Cook 
Catharine Suininerlin 
Martha Waldrlp 

.Madical Co liege of Georgia 
' Doris Maher » 

Georgia 'State University 
Phyllis Johnson 

North Geoigia College . 
Joan .M, Burnham 

South Georgia College " 
Mary I» Hipp c 



West Georgia College 
Jeanetta Bernhardt 



KENTUCKY 

Kantucky State University 
Cathy Cooke 
Sharon Grosse 
Mable J. Henderson 
Pattia Hunsicker 
Jean Jeff era , 
Veneda S. Martin 
Barbara C* Miranda 
Patsy 0, Turner 
Mary Wordell ' 



LOUISIANA ^ 

Louisiaria State University Medical 
Center ^ ^ 

Nancy M. Rankin 



mRYLMD 

. Coppin State ^ College 

Constance C, Pavlidas 
Elizabeth Ramsay 

Uffiversity of Maryland at Baltin|.pre 
Candanq.i Camillo = 
Kathleen J* Henderson 
Ann P. Morgan*^ 
Norma L* -Rawlings* 



Valdosta, State College 
Irma Jewell ^ 
Patricia La Fountain 
Larry McGae j ? * ^ 
Mary Margaret Richardson 



MISSISSIPPI 

Hinds Junior, .Collage 
» Jane Callahan ^ 
Mildred Haarn 
Helen Lairtbart 
Connie Toimsend 



*Program Participant 
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MISSI SSIPPI (Continued) 



Miesissippi University for Women 
Annette Barrar ^ ' . . 

* University of Mississippi Sahool 
of Nursing (Jackson) 
Dorothy Crow 
Bobbie Ward 

Univarsity of Southern Mississippi 
Shannon Graham 



NORTH C^OLINA 

Duke University 
Cynthia S, Luke'' 

North Carolina A&T State Uhiversity 
• . Veronica Fennell - 
Marie Martiii,, 
- Patrioia Shelt^n 

North Carolina . Central University 
Hor tense Ho Iman ■\- , 

Gwendolyn C* Jones 
Johnea D* Kelly 
Joan Martin 

Barbara- NiKon. ^ 
■ ' Sylvia 0, Richardson 

Western Piedniont 'Coiranunity College 
Patricia W. Grumpier 

^ SOUTH CAROLINA 

Lander College ^ .j 
Mary J* Branson 

Agnes M. . Luddy. = ' 

TENNESSEE 

Linpoln Memorial University 
Modena Beasley ■ 
Elizabeth Brook,, 



*Prograni Participant 



Sandy McKeehan 
Nancy Moody ■ 

Tennessee State University 
Pauline M, James 

University, of 'Tennessee at 
Knox vi lie 

Kathleen P • Conlon " 

Sylvia Hart' 

University of Tennessee at 
Nashville 

Carol C* Chapman 

Dorothy Laux 

Lily Mettler 

Rita PhillipB 



TEXAS ■ ' 

Alvin Community College - 
Eliee Hoffman ^ 

Texas Christian University 
Nancy Ackley 
Billie Hightower 
Ann Richards 
Linda Simmons 

Texarkana Community College 
Daline W* Ford 
^ \ Georgia. K. McFaul 
Paul McFerran 
Joyce White 

University of St. Thomas 
Shirley L, Dooling ^ 
Mary Guidry* 
John F, Madden 
Cindy Martindill 
Ellis L. Nordyke 

University of Texas at El Paso 
, ' Donna Mahr . " ' 

.1 
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VIRGINIA 



. Eastern Mennonlte College 
Ann Hardinger 

George Mason University 
^ Sandra Silvenf isch 

Hampton Institute 
Eleanor Lynch* 

J, Sargeant Reynolds Community 

Collage 

' Gwen Brannon 

VictcSria L. Kolevzon 

Sandy Minton 

Ann Pollard 

Fran Stanley 

Old Dominion 'University 
Clarie Horsean 

Shenandoah College 

Kate Cullers 
' Daris Small 



Tidewater Coiranunity Collage 
Goldie Bradley 
Fred H. Jeffcoate* 
Gail B, Kettlewell* 
^ Shirley Lee 

Norene Loose 



WEST VIRGINIA 

Marshall U^varsity 
EliEabeth Barker 
Kathryn Roberts 

Shepherd College 
Susan Layos 

Southern Wast Virginia Community 
College J^' 

Rose Irafford ) 

Rebecca Morris 

tery Nemeth ' . 

Mary Rado ,^ 

Wynona B. Timmons 

Janis Wertinan * 



Representatives From Other Agencies 



Lucy C, Blanton 

Virginia State Board of Nursing 
Richmond,^ Virginia 

Marjorie M. Luc 

^Louisiana State Board of Nursing 
New Orleans? Louisiana 

Eula Aiken 

Southern Regional Sduoation Board 
Atlanta^ Georgia 



.Maria Jones 

Kentucky Board of Nursing 

Louisville ^ Kentucky 

I' 

Marie Kennedy 
Region IV DHEW 
Atlanta, Georgia • 



\ 



Cassandra Hill 

Southern Regional Education Board 
Atlanta, Georgia 



*Program Partioipant 
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